Mapping Spikes to Sensations
Identifieur interne : 001A91 ( Pmc/Checkpoint ); précédent : 001A90; suivant : 001A92Mapping Spikes to Sensations
Auteurs : Maik C. Stüttgen [Allemagne] ; Cornelius Schwarz [Allemagne] ; Frank J Kel [Allemagne]Source :
- Frontiers in Neuroscience [ 1662-4548 ] ; 2011.
Abstract
Single-unit recordings conducted during perceptual decision-making tasks have yielded tremendous insights into the neural coding of sensory stimuli. In such experiments, detection or discrimination behavior (the psychometric data) is observed in parallel with spike trains in sensory neurons (the neurometric data). Frequently, candidate neural codes for information read-out are pitted against each other by transforming the neurometric data in some way and asking which code’s performance most closely approximates the psychometric performance. The code that matches the psychometric performance best is retained as a viable candidate and the others are rejected. In following this strategy, psychometric data is often considered to provide an unbiased measure of perceptual sensitivity. It is rarely acknowledged that psychometric data result from a complex interplay of sensory and non-sensory processes and that neglect of these processes may result in misestimating psychophysical sensitivity. This again may lead to erroneous conclusions regarding the adequacy of candidate neural codes. In this review, we first discuss requirements on the neural data for a subsequent neurometric-psychometric comparison. We then focus on different psychophysical tasks for the assessment of detection and discrimination performance and the cognitive processes that may underlie their execution. We discuss further factors that may compromise psychometric performance and how they can be detected or avoided. We believe that these considerations point to shortcomings in our understanding of the processes underlying perceptual decisions, and therefore offer potential for future research.
Url:
DOI: 10.3389/fnins.2011.00125
PubMed: 22084627
PubMed Central: 3212738
Affiliations:
Links toward previous steps (curation, corpus...)
Links to Exploration step
PMC:3212738Le document en format XML
<record><TEI><teiHeader><fileDesc><titleStmt><title xml:lang="en">Mapping Spikes to Sensations</title>
<author><name sortKey="Stuttgen, Maik C" sort="Stuttgen, Maik C" uniqKey="Stuttgen M" first="Maik C." last="Stüttgen">Maik C. Stüttgen</name>
<affiliation wicri:level="1"><nlm:aff id="aff1"><institution>Department of Biopsychology, University of Bochum</institution>
<country>Bochum, Germany</country>
</nlm:aff>
<country xml:lang="fr">Allemagne</country>
<wicri:regionArea></wicri:regionArea>
<wicri:regionArea># see nlm:aff region in country</wicri:regionArea>
</affiliation>
</author>
<author><name sortKey="Schwarz, Cornelius" sort="Schwarz, Cornelius" uniqKey="Schwarz C" first="Cornelius" last="Schwarz">Cornelius Schwarz</name>
<affiliation wicri:level="1"><nlm:aff id="aff2"><institution>Systems Neurophysiology, Werner Reichardt Centre for Integrative Neuroscience, University of Tübingen</institution>
<country>Tübingen, Germany</country>
</nlm:aff>
<country xml:lang="fr">Allemagne</country>
<wicri:regionArea></wicri:regionArea>
<wicri:regionArea># see nlm:aff region in country</wicri:regionArea>
</affiliation>
<affiliation wicri:level="1"><nlm:aff id="aff3"><institution>Department of Cognitive Neurology, Hertie Institute for Clinical Brain Research, University of Tübingen</institution>
<country>Tübingen, Germany</country>
</nlm:aff>
<country xml:lang="fr">Allemagne</country>
<wicri:regionArea></wicri:regionArea>
<wicri:regionArea># see nlm:aff region in country</wicri:regionArea>
</affiliation>
</author>
<author><name sortKey="J Kel, Frank" sort="J Kel, Frank" uniqKey="J Kel F" first="Frank" last="J Kel">Frank J Kel</name>
<affiliation wicri:level="1"><nlm:aff id="aff4"><institution>Institute of Cognitive Science, University of Osnabrück</institution>
<country>Osnabrück, Germany</country>
</nlm:aff>
<country xml:lang="fr">Allemagne</country>
<wicri:regionArea></wicri:regionArea>
<wicri:regionArea># see nlm:aff region in country</wicri:regionArea>
</affiliation>
</author>
</titleStmt>
<publicationStmt><idno type="wicri:source">PMC</idno>
<idno type="pmid">22084627</idno>
<idno type="pmc">3212738</idno>
<idno type="url">http://www.ncbi.nlm.nih.gov/pmc/articles/PMC3212738</idno>
<idno type="RBID">PMC:3212738</idno>
<idno type="doi">10.3389/fnins.2011.00125</idno>
<date when="2011">2011</date>
<idno type="wicri:Area/Pmc/Corpus">002707</idno>
<idno type="wicri:Area/Pmc/Curation">002707</idno>
<idno type="wicri:Area/Pmc/Checkpoint">001A91</idno>
</publicationStmt>
<sourceDesc><biblStruct><analytic><title xml:lang="en" level="a" type="main">Mapping Spikes to Sensations</title>
<author><name sortKey="Stuttgen, Maik C" sort="Stuttgen, Maik C" uniqKey="Stuttgen M" first="Maik C." last="Stüttgen">Maik C. Stüttgen</name>
<affiliation wicri:level="1"><nlm:aff id="aff1"><institution>Department of Biopsychology, University of Bochum</institution>
<country>Bochum, Germany</country>
</nlm:aff>
<country xml:lang="fr">Allemagne</country>
<wicri:regionArea></wicri:regionArea>
<wicri:regionArea># see nlm:aff region in country</wicri:regionArea>
</affiliation>
</author>
<author><name sortKey="Schwarz, Cornelius" sort="Schwarz, Cornelius" uniqKey="Schwarz C" first="Cornelius" last="Schwarz">Cornelius Schwarz</name>
<affiliation wicri:level="1"><nlm:aff id="aff2"><institution>Systems Neurophysiology, Werner Reichardt Centre for Integrative Neuroscience, University of Tübingen</institution>
<country>Tübingen, Germany</country>
</nlm:aff>
<country xml:lang="fr">Allemagne</country>
<wicri:regionArea></wicri:regionArea>
<wicri:regionArea># see nlm:aff region in country</wicri:regionArea>
</affiliation>
<affiliation wicri:level="1"><nlm:aff id="aff3"><institution>Department of Cognitive Neurology, Hertie Institute for Clinical Brain Research, University of Tübingen</institution>
<country>Tübingen, Germany</country>
</nlm:aff>
<country xml:lang="fr">Allemagne</country>
<wicri:regionArea></wicri:regionArea>
<wicri:regionArea># see nlm:aff region in country</wicri:regionArea>
</affiliation>
</author>
<author><name sortKey="J Kel, Frank" sort="J Kel, Frank" uniqKey="J Kel F" first="Frank" last="J Kel">Frank J Kel</name>
<affiliation wicri:level="1"><nlm:aff id="aff4"><institution>Institute of Cognitive Science, University of Osnabrück</institution>
<country>Osnabrück, Germany</country>
</nlm:aff>
<country xml:lang="fr">Allemagne</country>
<wicri:regionArea></wicri:regionArea>
<wicri:regionArea># see nlm:aff region in country</wicri:regionArea>
</affiliation>
</author>
</analytic>
<series><title level="j">Frontiers in Neuroscience</title>
<idno type="ISSN">1662-4548</idno>
<idno type="eISSN">1662-453X</idno>
<imprint><date when="2011">2011</date>
</imprint>
</series>
</biblStruct>
</sourceDesc>
</fileDesc>
<profileDesc><textClass></textClass>
</profileDesc>
</teiHeader>
<front><div type="abstract" xml:lang="en"><p>Single-unit recordings conducted during perceptual decision-making tasks have yielded tremendous insights into the neural coding of sensory stimuli. In such experiments, detection or discrimination behavior (the psychometric data) is observed in parallel with spike trains in sensory neurons (the neurometric data). Frequently, candidate neural codes for information read-out are pitted against each other by transforming the neurometric data in some way and asking which code’s performance most closely approximates the psychometric performance. The code that matches the psychometric performance best is retained as a viable candidate and the others are rejected. In following this strategy, psychometric data is often considered to provide an unbiased measure of perceptual sensitivity. It is rarely acknowledged that psychometric data result from a complex interplay of sensory and non-sensory processes and that neglect of these processes may result in misestimating psychophysical sensitivity. This again may lead to erroneous conclusions regarding the adequacy of candidate neural codes. In this review, we first discuss requirements on the neural data for a subsequent neurometric-psychometric comparison. We then focus on different psychophysical tasks for the assessment of detection and discrimination performance and the cognitive processes that may underlie their execution. We discuss further factors that may compromise psychometric performance and how they can be detected or avoided. We believe that these considerations point to shortcomings in our understanding of the processes underlying perceptual decisions, and therefore offer potential for future research.</p>
</div>
</front>
<back><div1 type="bibliography"><listBibl><biblStruct><analytic><author><name sortKey="Adibi, M" uniqKey="Adibi M">M. Adibi</name>
</author>
<author><name sortKey="Arabzadeh, E" uniqKey="Arabzadeh E">E. Arabzadeh</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Andermann, M L" uniqKey="Andermann M">M. L. Andermann</name>
</author>
<author><name sortKey="Kerlin, A M" uniqKey="Kerlin A">A. M. Kerlin</name>
</author>
<author><name sortKey="Reid, R C" uniqKey="Reid R">R. C. Reid</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Arabzadeh, E" uniqKey="Arabzadeh E">E. Arabzadeh</name>
</author>
<author><name sortKey="Panzeri, S" uniqKey="Panzeri S">S. Panzeri</name>
</author>
<author><name sortKey="Diamond, M E" uniqKey="Diamond M">M. E. Diamond</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Baird, J C" uniqKey="Baird J">J. C. Baird</name>
</author>
<author><name sortKey="Noma, E J" uniqKey="Noma E">E. J. Noma</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Barlow, H B" uniqKey="Barlow H">H. B. Barlow</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Barlow, H B" uniqKey="Barlow H">H. B. Barlow</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Bialek, W" uniqKey="Bialek W">W. Bialek</name>
</author>
<author><name sortKey="Rieke, F" uniqKey="Rieke F">F. Rieke</name>
</author>
<author><name sortKey="De Ruyter Van Steveninck, R R" uniqKey="De Ruyter Van Steveninck R">R. R. de Ruyter van Steveninck</name>
</author>
<author><name sortKey="Warland, D" uniqKey="Warland D">D. Warland</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Bizley, J K" uniqKey="Bizley J">J. K. Bizley</name>
</author>
<author><name sortKey="Walker, K M M" uniqKey="Walker K">K. M. M. Walker</name>
</author>
<author><name sortKey="King, A J" uniqKey="King A">A. J. King</name>
</author>
<author><name sortKey="Schnupp, J W H" uniqKey="Schnupp J">J. W. H. Schnupp</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Blackwell, H R" uniqKey="Blackwell H">H. R. Blackwell</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Blough, P M" uniqKey="Blough P">P. M. Blough</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Boneau, C A" uniqKey="Boneau C">C. A. Boneau</name>
</author>
<author><name sortKey="Cole, J L" uniqKey="Cole J">J. L. Cole</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Boneau, C A" uniqKey="Boneau C">C. A. Boneau</name>
</author>
<author><name sortKey="Holland, M K" uniqKey="Holland M">M. K. Holland</name>
</author>
<author><name sortKey="Baker, W M" uniqKey="Baker W">W. M. Baker</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Briggman, K L" uniqKey="Briggman K">K. L. Briggman</name>
</author>
<author><name sortKey="Abarbanel, H D" uniqKey="Abarbanel H">H. D. Abarbanel</name>
</author>
<author><name sortKey="Kristan, W B" uniqKey="Kristan W">W. B. Kristan</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Britten, K H" uniqKey="Britten K">K. H. Britten</name>
</author>
<author><name sortKey="Newsome, W T" uniqKey="Newsome W">W. T. Newsome</name>
</author>
<author><name sortKey="Shadlen, M N" uniqKey="Shadlen M">M. N. Shadlen</name>
</author>
<author><name sortKey="Celebrini, S" uniqKey="Celebrini S">S. Celebrini</name>
</author>
<author><name sortKey="Movshon, J A" uniqKey="Movshon J">J. A. Movshon</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Britten, K H" uniqKey="Britten K">K. H. Britten</name>
</author>
<author><name sortKey="Shadlen, M N" uniqKey="Shadlen M">M. N. Shadlen</name>
</author>
<author><name sortKey="Newsome, W T" uniqKey="Newsome W">W. T. Newsome</name>
</author>
<author><name sortKey="Movshon, J A" uniqKey="Movshon J">J. A. Movshon</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Busse, L" uniqKey="Busse L">L. Busse</name>
</author>
<author><name sortKey="Ayaz, A" uniqKey="Ayaz A">A. Ayaz</name>
</author>
<author><name sortKey="Dhruv, N T" uniqKey="Dhruv N">N. T. Dhruv</name>
</author>
<author><name sortKey="Katzner, S" uniqKey="Katzner S">S. Katzner</name>
</author>
<author><name sortKey="Saleem, A B" uniqKey="Saleem A">A. B. Saleem</name>
</author>
<author><name sortKey="Scholvinck, M L" uniqKey="Scholvinck M">M. L. Scholvinck</name>
</author>
<author><name sortKey="Zaharia, A D" uniqKey="Zaharia A">A. D. Zaharia</name>
</author>
<author><name sortKey="Carandini, M" uniqKey="Carandini M">M. Carandini</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Celebrini, S" uniqKey="Celebrini S">S. Celebrini</name>
</author>
<author><name sortKey="Newsome, W T" uniqKey="Newsome W">W. T. Newsome</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Churchland, A K" uniqKey="Churchland A">A. K. Churchland</name>
</author>
<author><name sortKey="Kiani, R" uniqKey="Kiani R">R. Kiani</name>
</author>
<author><name sortKey="Shadlen, M N" uniqKey="Shadlen M">M. N. Shadlen</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Cohen, M R" uniqKey="Cohen M">M. R. Cohen</name>
</author>
<author><name sortKey="Newsome, W T" uniqKey="Newsome W">W. T. Newsome</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Cohen, M R" uniqKey="Cohen M">M. R. Cohen</name>
</author>
<author><name sortKey="Newsome, W T" uniqKey="Newsome W">W. T. Newsome</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Cook, E P" uniqKey="Cook E">E. P. Cook</name>
</author>
<author><name sortKey="Maunsell, J H" uniqKey="Maunsell J">J. H. Maunsell</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="De Lafuente, V" uniqKey="De Lafuente V">V. de Lafuente</name>
</author>
<author><name sortKey="Romo, R" uniqKey="Romo R">R. Romo</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="De Ruyter Van Steveninck, R R" uniqKey="De Ruyter Van Steveninck R">R. R. de Ruyter van Steveninck</name>
</author>
<author><name sortKey="Lewen, G D" uniqKey="Lewen G">G. D. Lewen</name>
</author>
<author><name sortKey="Strong, S P" uniqKey="Strong S">S. P. Strong</name>
</author>
<author><name sortKey="Koberle, R" uniqKey="Koberle R">R. Koberle</name>
</author>
<author><name sortKey="Bialek, W" uniqKey="Bialek W">W. Bialek</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Diester, I" uniqKey="Diester I">I. Diester</name>
</author>
<author><name sortKey="Kaufman, M T" uniqKey="Kaufman M">M. T. Kaufman</name>
</author>
<author><name sortKey="Mogri, M" uniqKey="Mogri M">M. Mogri</name>
</author>
<author><name sortKey="Pashaie, R" uniqKey="Pashaie R">R. Pashaie</name>
</author>
<author><name sortKey="Goo, W" uniqKey="Goo W">W. Goo</name>
</author>
<author><name sortKey="Yizhar, O" uniqKey="Yizhar O">O. Yizhar</name>
</author>
<author><name sortKey="Ramakrishnan, C" uniqKey="Ramakrishnan C">C. Ramakrishnan</name>
</author>
<author><name sortKey="Deisseroth, K" uniqKey="Deisseroth K">K. Deisseroth</name>
</author>
<author><name sortKey="Shenoy, K V" uniqKey="Shenoy K">K. V. Shenoy</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Dodd, J V" uniqKey="Dodd J">J. V. Dodd</name>
</author>
<author><name sortKey="Krug, K" uniqKey="Krug K">K. Krug</name>
</author>
<author><name sortKey="Cumming, B G" uniqKey="Cumming B">B. G. Cumming</name>
</author>
<author><name sortKey="Parker, A J" uniqKey="Parker A">A. J. Parker</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Evarts, E V" uniqKey="Evarts E">E. V. Evarts</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Fechner, G T" uniqKey="Fechner G">G. T. Fechner</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Feierstein, C E" uniqKey="Feierstein C">C. E. Feierstein</name>
</author>
<author><name sortKey="Quirk, M C" uniqKey="Quirk M">M. C. Quirk</name>
</author>
<author><name sortKey="Uchida, N" uniqKey="Uchida N">N. Uchida</name>
</author>
<author><name sortKey="Sosulski, D L" uniqKey="Sosulski D">D. L. Sosulski</name>
</author>
<author><name sortKey="Mainen, Z F" uniqKey="Mainen Z">Z. F. Mainen</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Feng, S" uniqKey="Feng S">S. Feng</name>
</author>
<author><name sortKey="Holmes, P" uniqKey="Holmes P">P. Holmes</name>
</author>
<author><name sortKey="Rorie, A" uniqKey="Rorie A">A. Rorie</name>
</author>
<author><name sortKey="Newsome, W T" uniqKey="Newsome W">W. T. Newsome</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Fine, I" uniqKey="Fine I">I. Fine</name>
</author>
<author><name sortKey="Jacobs, R A" uniqKey="Jacobs R">R. A. Jacobs</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Frederick, D E" uniqKey="Frederick D">D. E. Frederick</name>
</author>
<author><name sortKey="Rojas Libano, D" uniqKey="Rojas Libano D">D. Rojas-Libano</name>
</author>
<author><name sortKey="Scott, M" uniqKey="Scott M">M. Scott</name>
</author>
<author><name sortKey="Kay, L M" uniqKey="Kay L">L. M. Kay</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Fruend, I" uniqKey="Fruend I">I. Fruend</name>
</author>
<author><name sortKey="Haenel, N V" uniqKey="Haenel N">N. V. Haenel</name>
</author>
<author><name sortKey="Wichmann, F A" uniqKey="Wichmann F">F. A. Wichmann</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Furuta, T" uniqKey="Furuta T">T. Furuta</name>
</author>
<author><name sortKey="Urbain, N" uniqKey="Urbain N">N. Urbain</name>
</author>
<author><name sortKey="Kaneko, T" uniqKey="Kaneko T">T. Kaneko</name>
</author>
<author><name sortKey="Deschenes, M" uniqKey="Deschenes M">M. Deschenes</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Garcia Perez, M A" uniqKey="Garcia Perez M">M. A. Garcia-Perez</name>
</author>
<author><name sortKey="Alcala Quintana, R" uniqKey="Alcala Quintana R">R. Alcala-Quintana</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Geisler, W S" uniqKey="Geisler W">W. S. Geisler</name>
</author>
<author><name sortKey="Albrecht, D G" uniqKey="Albrecht D">D. G. Albrecht</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Gerdjikov, T V" uniqKey="Gerdjikov T">T. V. Gerdjikov</name>
</author>
<author><name sortKey="Bergner, C G" uniqKey="Bergner C">C. G. Bergner</name>
</author>
<author><name sortKey="Stuttgen, M C" uniqKey="Stuttgen M">M. C. Stüttgen</name>
</author>
<author><name sortKey="Waiblinger, C" uniqKey="Waiblinger C">C. Waiblinger</name>
</author>
<author><name sortKey="Schwarz, C" uniqKey="Schwarz C">C. Schwarz</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Gold, J I" uniqKey="Gold J">J. I. Gold</name>
</author>
<author><name sortKey="Shadlen, M N" uniqKey="Shadlen M">M. N. Shadlen</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Gold, J I" uniqKey="Gold J">J. I. Gold</name>
</author>
<author><name sortKey="Shadlen, M N" uniqKey="Shadlen M">M. N. Shadlen</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Gomez, P" uniqKey="Gomez P">P. Gomez</name>
</author>
<author><name sortKey="Ratcliff, R" uniqKey="Ratcliff R">R. Ratcliff</name>
</author>
<author><name sortKey="Perea, M" uniqKey="Perea M">M. Perea</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Goto, K" uniqKey="Goto K">K. Goto</name>
</author>
<author><name sortKey="Kurashima, R" uniqKey="Kurashima R">R. Kurashima</name>
</author>
<author><name sortKey="Watanabe, S" uniqKey="Watanabe S">S. Watanabe</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Green, D M" uniqKey="Green D">D. M. Green</name>
</author>
<author><name sortKey="Forrest, T G" uniqKey="Forrest T">T. G. Forrest</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Green, D M" uniqKey="Green D">D. M. Green</name>
</author>
<author><name sortKey="Swets, J A" uniqKey="Swets J">J. A. Swets</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Green, D M" uniqKey="Green D">D. M. Green</name>
</author>
<author><name sortKey="Weber, D L" uniqKey="Weber D">D. L. Weber</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Haehnel, M" uniqKey="Haehnel M">M. Haehnel</name>
</author>
<author><name sortKey="Froese, A" uniqKey="Froese A">A. Froese</name>
</author>
<author><name sortKey="Menzel, R" uniqKey="Menzel R">R. Menzel</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Harris, J A" uniqKey="Harris J">J. A. Harris</name>
</author>
<author><name sortKey="Harris, I M" uniqKey="Harris I">I. M. Harris</name>
</author>
<author><name sortKey="Diamond, M E" uniqKey="Diamond M">M. E. Diamond</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Hautus, M J" uniqKey="Hautus M">M. J. Hautus</name>
</author>
<author><name sortKey="Van Hout, D" uniqKey="Van Hout D">D. van Hout</name>
</author>
<author><name sortKey="Lee, H S" uniqKey="Lee H">H. S. Lee</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Hecht, S" uniqKey="Hecht S">S. Hecht</name>
</author>
<author><name sortKey="Shlaer, S" uniqKey="Shlaer S">S. Shlaer</name>
</author>
<author><name sortKey="Pirenne, M H" uniqKey="Pirenne M">M. H. Pirenne</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Hernandez, A" uniqKey="Hernandez A">A. Hernandez</name>
</author>
<author><name sortKey="Salinas, E" uniqKey="Salinas E">E. Salinas</name>
</author>
<author><name sortKey="Garcia, R" uniqKey="Garcia R">R. Garcia</name>
</author>
<author><name sortKey="Romo, R" uniqKey="Romo R">R. Romo</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Hernandez, A" uniqKey="Hernandez A">A. Hernandez</name>
</author>
<author><name sortKey="Zainos, A" uniqKey="Zainos A">A. Zainos</name>
</author>
<author><name sortKey="Romo, R" uniqKey="Romo R">R. Romo</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Heuer, H W" uniqKey="Heuer H">H. W. Heuer</name>
</author>
<author><name sortKey="Britten, K H" uniqKey="Britten K">K. H. Britten</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Houweling, A R" uniqKey="Houweling A">A. R. Houweling</name>
</author>
<author><name sortKey="Brecht, M" uniqKey="Brecht M">M. Brecht</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Houweling, A R" uniqKey="Houweling A">A. R. Houweling</name>
</author>
<author><name sortKey="Doron, G" uniqKey="Doron G">G. Doron</name>
</author>
<author><name sortKey="Voigt, B C" uniqKey="Voigt B">B. C. Voigt</name>
</author>
<author><name sortKey="Herfst, L J" uniqKey="Herfst L">L. J. Herfst</name>
</author>
<author><name sortKey="Brecht, M" uniqKey="Brecht M">M. Brecht</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Jacobs, A L" uniqKey="Jacobs A">A. L. Jacobs</name>
</author>
<author><name sortKey="Fridman, G" uniqKey="Fridman G">G. Fridman</name>
</author>
<author><name sortKey="Douglas, R M" uniqKey="Douglas R">R. M. Douglas</name>
</author>
<author><name sortKey="Alam, N M" uniqKey="Alam N">N. M. Alam</name>
</author>
<author><name sortKey="Latham, P E" uniqKey="Latham P">P. E. Latham</name>
</author>
<author><name sortKey="Prusky, G T" uniqKey="Prusky G">G. T. Prusky</name>
</author>
<author><name sortKey="Nirenberg, S" uniqKey="Nirenberg S">S. Nirenberg</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="J Kel, F" uniqKey="J Kel F">F. Jäkel</name>
</author>
<author><name sortKey="Wichmann, F A" uniqKey="Wichmann F">F. A. Wichmann</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Jang, Y" uniqKey="Jang Y">Y. Jang</name>
</author>
<author><name sortKey="Wixted, J T" uniqKey="Wixted J">J. T. Wixted</name>
</author>
<author><name sortKey="Huber, D E" uniqKey="Huber D">D. E. Huber</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Johansson, R S" uniqKey="Johansson R">R. S. Johansson</name>
</author>
<author><name sortKey="Vallbo, A B" uniqKey="Vallbo A">A. B. Vallbo</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Kepecs, A" uniqKey="Kepecs A">A. Kepecs</name>
</author>
<author><name sortKey="Uchida, N" uniqKey="Uchida N">N. Uchida</name>
</author>
<author><name sortKey="Zariwala, H A" uniqKey="Zariwala H">H. A. Zariwala</name>
</author>
<author><name sortKey="Mainen, Z F" uniqKey="Mainen Z">Z. F. Mainen</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Kesner, R P" uniqKey="Kesner R">R. P. Kesner</name>
</author>
<author><name sortKey="Hunt, M E" uniqKey="Hunt M">M. E. Hunt</name>
</author>
<author><name sortKey="Williams, J M" uniqKey="Williams J">J. M. Williams</name>
</author>
<author><name sortKey="Long, J M" uniqKey="Long J">J. M. Long</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Kingdom, F A A" uniqKey="Kingdom F">F. A. A. Kingdom</name>
</author>
<author><name sortKey="Prins, N" uniqKey="Prins N">N. Prins</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Klein, S A" uniqKey="Klein S">S. A. Klein</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Knutsen, P M" uniqKey="Knutsen P">P. M. Knutsen</name>
</author>
<author><name sortKey="Pietr, M" uniqKey="Pietr M">M. Pietr</name>
</author>
<author><name sortKey="Ahissar, E" uniqKey="Ahissar E">E. Ahissar</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Krupa, D J" uniqKey="Krupa D">D. J. Krupa</name>
</author>
<author><name sortKey="Matell, M S" uniqKey="Matell M">M. S. Matell</name>
</author>
<author><name sortKey="Brisben, A J" uniqKey="Brisben A">A. J. Brisben</name>
</author>
<author><name sortKey="Oliveira, L M" uniqKey="Oliveira L">L. M. Oliveira</name>
</author>
<author><name sortKey="Nicolelis, M A" uniqKey="Nicolelis M">M. A. Nicolelis</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Lages, M" uniqKey="Lages M">M. Lages</name>
</author>
<author><name sortKey="Treisman, M" uniqKey="Treisman M">M. Treisman</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Lee, H S" uniqKey="Lee H">H. S. Lee</name>
</author>
<author><name sortKey="Van Hout, D" uniqKey="Van Hout D">D. van Hout</name>
</author>
<author><name sortKey="Hautus, M J" uniqKey="Hautus M">M. J. Hautus</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Lissek, S" uniqKey="Lissek S">S. Lissek</name>
</author>
<author><name sortKey="Gunturkun, O" uniqKey="Gunturkun O">O. Güntürkün</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Luna, R" uniqKey="Luna R">R. Luna</name>
</author>
<author><name sortKey="Hernandez, A" uniqKey="Hernandez A">A. Hernandez</name>
</author>
<author><name sortKey="Brody, C D" uniqKey="Brody C">C. D. Brody</name>
</author>
<author><name sortKey="Romo, R" uniqKey="Romo R">R. Romo</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Machens, C K" uniqKey="Machens C">C. K. Machens</name>
</author>
<author><name sortKey="Romo, R" uniqKey="Romo R">R. Romo</name>
</author>
<author><name sortKey="Brody, C D" uniqKey="Brody C">C. D. Brody</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Macmillan, N A" uniqKey="Macmillan N">N. A. MacMillan</name>
</author>
<author><name sortKey="Creelman, C D" uniqKey="Creelman C">C. D. Creelman</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Mccarthy, D" uniqKey="Mccarthy D">D. McCarthy</name>
</author>
<author><name sortKey="Davison, M" uniqKey="Davison M">M. Davison</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Mehta, S B" uniqKey="Mehta S">S. B. Mehta</name>
</author>
<author><name sortKey="Whitmer, D" uniqKey="Whitmer D">D. Whitmer</name>
</author>
<author><name sortKey="Figueroa, R" uniqKey="Figueroa R">R. Figueroa</name>
</author>
<author><name sortKey="Williams, B A" uniqKey="Williams B">B. A. Williams</name>
</author>
<author><name sortKey="Kleinfeld, D" uniqKey="Kleinfeld D">D. Kleinfeld</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Mentzer, T L" uniqKey="Mentzer T">T. L. Mentzer</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Menzel, R" uniqKey="Menzel R">R. Menzel</name>
</author>
<author><name sortKey="Giurfa, M" uniqKey="Giurfa M">M. Giurfa</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Mountcastle, V B" uniqKey="Mountcastle V">V. B. Mountcastle</name>
</author>
<author><name sortKey="Steinmetz, M A" uniqKey="Steinmetz M">M. A. Steinmetz</name>
</author>
<author><name sortKey="Romo, R" uniqKey="Romo R">R. Romo</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Nachmias, J" uniqKey="Nachmias J">J. Nachmias</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Newsome, W T" uniqKey="Newsome W">W. T. Newsome</name>
</author>
<author><name sortKey="Britten, K H" uniqKey="Britten K">K. H. Britten</name>
</author>
<author><name sortKey="Movshon, J A" uniqKey="Movshon J">J. A. Movshon</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Nienborg, H" uniqKey="Nienborg H">H. Nienborg</name>
</author>
<author><name sortKey="Cumming, B" uniqKey="Cumming B">B. Cumming</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Nienborg, H" uniqKey="Nienborg H">H. Nienborg</name>
</author>
<author><name sortKey="Cumming, B G" uniqKey="Cumming B">B. G. Cumming</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Nienborg, H" uniqKey="Nienborg H">H. Nienborg</name>
</author>
<author><name sortKey="Cumming, B G" uniqKey="Cumming B">B. G. Cumming</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Nienborg, H" uniqKey="Nienborg H">H. Nienborg</name>
</author>
<author><name sortKey="Cumming, B G" uniqKey="Cumming B">B. G. Cumming</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Ochoa, J" uniqKey="Ochoa J">J. Ochoa</name>
</author>
<author><name sortKey="Torebjork, E" uniqKey="Torebjork E">E. Torebjork</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="O Onnor, D H" uniqKey="O Onnor D">D. H. O’Connor</name>
</author>
<author><name sortKey="Clack, N G" uniqKey="Clack N">N. G. Clack</name>
</author>
<author><name sortKey="Huber, D" uniqKey="Huber D">D. Huber</name>
</author>
<author><name sortKey="Komiyama, T" uniqKey="Komiyama T">T. Komiyama</name>
</author>
<author><name sortKey="Myers, E W" uniqKey="Myers E">E. W. Myers</name>
</author>
<author><name sortKey="Svoboda, K" uniqKey="Svoboda K">K. Svoboda</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="O Onnor, D H" uniqKey="O Onnor D">D. H. O’Connor</name>
</author>
<author><name sortKey="Peron, S P" uniqKey="Peron S">S. P. Peron</name>
</author>
<author><name sortKey="Huber, D" uniqKey="Huber D">D. Huber</name>
</author>
<author><name sortKey="Svoboda, K" uniqKey="Svoboda K">K. Svoboda</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Ohiorhenuan, I E" uniqKey="Ohiorhenuan I">I. E. Ohiorhenuan</name>
</author>
<author><name sortKey="Mechler, F" uniqKey="Mechler F">F. Mechler</name>
</author>
<author><name sortKey="Purpura, K P" uniqKey="Purpura K">K. P. Purpura</name>
</author>
<author><name sortKey="Schmid, A M" uniqKey="Schmid A">A. M. Schmid</name>
</author>
<author><name sortKey="Hu, Q" uniqKey="Hu Q">Q. Hu</name>
</author>
<author><name sortKey="Victor, J D" uniqKey="Victor J">J. D. Victor</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Palmer, C" uniqKey="Palmer C">C. Palmer</name>
</author>
<author><name sortKey="Cheng, S Y" uniqKey="Cheng S">S. Y. Cheng</name>
</author>
<author><name sortKey="Seidemann, E" uniqKey="Seidemann E">E. Seidemann</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Parker, A J" uniqKey="Parker A">A. J. Parker</name>
</author>
<author><name sortKey="Newsome, W T" uniqKey="Newsome W">W. T. Newsome</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Polley, D B" uniqKey="Polley D">D. B. Polley</name>
</author>
<author><name sortKey="Heiser, M A" uniqKey="Heiser M">M. A. Heiser</name>
</author>
<author><name sortKey="Blake, D T" uniqKey="Blake D">D. T. Blake</name>
</author>
<author><name sortKey="Schreiner, C E" uniqKey="Schreiner C">C. E. Schreiner</name>
</author>
<author><name sortKey="Merzenich, M M" uniqKey="Merzenich M">M. M. Merzenich</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Pompilio, L" uniqKey="Pompilio L">L. Pompilio</name>
</author>
<author><name sortKey="Kacelnik, A" uniqKey="Kacelnik A">A. Kacelnik</name>
</author>
<author><name sortKey="Behmer, S T" uniqKey="Behmer S">S. T. Behmer</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Poulton, E C" uniqKey="Poulton E">E. C. Poulton</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Prigg, T" uniqKey="Prigg T">T. Prigg</name>
</author>
<author><name sortKey="Goldreich, D" uniqKey="Goldreich D">D. Goldreich</name>
</author>
<author><name sortKey="Carvell, G E" uniqKey="Carvell G">G. E. Carvell</name>
</author>
<author><name sortKey="Simons, D J" uniqKey="Simons D">D. J. Simons</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Purushothaman, G" uniqKey="Purushothaman G">G. Purushothaman</name>
</author>
<author><name sortKey="Bradley, D C" uniqKey="Bradley D">D. C. Bradley</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Qin, L" uniqKey="Qin L">L. Qin</name>
</author>
<author><name sortKey="Liu, Y C" uniqKey="Liu Y">Y. C. Liu</name>
</author>
<author><name sortKey="Wang, J Y" uniqKey="Wang J">J. Y. Wang</name>
</author>
<author><name sortKey="Li, S N" uniqKey="Li S">S. N. Li</name>
</author>
<author><name sortKey="Sato, Y" uniqKey="Sato Y">Y. Sato</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Resulaj, A" uniqKey="Resulaj A">A. Resulaj</name>
</author>
<author><name sortKey="Kiani, R" uniqKey="Kiani R">R. Kiani</name>
</author>
<author><name sortKey="Wolpert, D M" uniqKey="Wolpert D">D. M. Wolpert</name>
</author>
<author><name sortKey="Shadlen, M N" uniqKey="Shadlen M">M. N. Shadlen</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Riehle, A" uniqKey="Riehle A">A. Riehle</name>
</author>
<author><name sortKey="Grun, S" uniqKey="Grun S">S. Grun</name>
</author>
<author><name sortKey="Diesmann, M" uniqKey="Diesmann M">M. Diesmann</name>
</author>
<author><name sortKey="Aertsen, A" uniqKey="Aertsen A">A. Aertsen</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Roeder, K D" uniqKey="Roeder K">K. D. Roeder</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Roitman, J D" uniqKey="Roitman J">J. D. Roitman</name>
</author>
<author><name sortKey="Shadlen, M N" uniqKey="Shadlen M">M. N. Shadlen</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Romo, R" uniqKey="Romo R">R. Romo</name>
</author>
<author><name sortKey="Brody, C D" uniqKey="Brody C">C. D. Brody</name>
</author>
<author><name sortKey="Hernandez, A" uniqKey="Hernandez A">A. Hernandez</name>
</author>
<author><name sortKey="Lemus, L" uniqKey="Lemus L">L. Lemus</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Romo, R" uniqKey="Romo R">R. Romo</name>
</author>
<author><name sortKey="Salinas, E" uniqKey="Salinas E">E. Salinas</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Rorie, A E" uniqKey="Rorie A">A. E. Rorie</name>
</author>
<author><name sortKey="Gao, J" uniqKey="Gao J">J. Gao</name>
</author>
<author><name sortKey="Mcclelland, J L" uniqKey="Mcclelland J">J. L. McClelland</name>
</author>
<author><name sortKey="Newsome, W T" uniqKey="Newsome W">W. T. Newsome</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Sakitt, B" uniqKey="Sakitt B">B. Sakitt</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Salinas, E" uniqKey="Salinas E">E. Salinas</name>
</author>
<author><name sortKey="Hernandez, A" uniqKey="Hernandez A">A. Hernandez</name>
</author>
<author><name sortKey="Zainos, A" uniqKey="Zainos A">A. Zainos</name>
</author>
<author><name sortKey="Romo, R" uniqKey="Romo R">R. Romo</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Schneidman, E" uniqKey="Schneidman E">E. Schneidman</name>
</author>
<author><name sortKey="Berry, M J" uniqKey="Berry M">M. J. Berry</name>
</author>
<author><name sortKey="Segev, R" uniqKey="Segev R">R. Segev</name>
</author>
<author><name sortKey="Bialek, W" uniqKey="Bialek W">W. Bialek</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Schwarz, C" uniqKey="Schwarz C">C. Schwarz</name>
</author>
<author><name sortKey="Hentschke, H" uniqKey="Hentschke H">H. Hentschke</name>
</author>
<author><name sortKey="Butovas, S" uniqKey="Butovas S">S. Butovas</name>
</author>
<author><name sortKey="Haiss, F" uniqKey="Haiss F">F. Haiss</name>
</author>
<author><name sortKey="Stuttgen, M C" uniqKey="Stuttgen M">M. C. Stüttgen</name>
</author>
<author><name sortKey="Gerdjikov, T V" uniqKey="Gerdjikov T">T. V. Gerdjikov</name>
</author>
<author><name sortKey="Bergner, C G" uniqKey="Bergner C">C. G. Bergner</name>
</author>
<author><name sortKey="Waiblinger, C" uniqKey="Waiblinger C">C. Waiblinger</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Shadlen, M N" uniqKey="Shadlen M">M. N. Shadlen</name>
</author>
<author><name sortKey="Britten, K H" uniqKey="Britten K">K. H. Britten</name>
</author>
<author><name sortKey="Newsome, W T" uniqKey="Newsome W">W. T. Newsome</name>
</author>
<author><name sortKey="Movshon, J A" uniqKey="Movshon J">J. A. Movshon</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Sherrington, C" uniqKey="Sherrington C">C. Sherrington</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Shipley, E F" uniqKey="Shipley E">E. F. Shipley</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Shlens, J" uniqKey="Shlens J">J. Shlens</name>
</author>
<author><name sortKey="Field, G D" uniqKey="Field G">G. D. Field</name>
</author>
<author><name sortKey="Gauthier, J L" uniqKey="Gauthier J">J. L. Gauthier</name>
</author>
<author><name sortKey="Greschner, M" uniqKey="Greschner M">M. Greschner</name>
</author>
<author><name sortKey="Sher, A" uniqKey="Sher A">A. Sher</name>
</author>
<author><name sortKey="Litke, A M" uniqKey="Litke A">A. M. Litke</name>
</author>
<author><name sortKey="Chichilnisky, E J" uniqKey="Chichilnisky E">E. J. Chichilnisky</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Shlens, J" uniqKey="Shlens J">J. Shlens</name>
</author>
<author><name sortKey="Field, G D" uniqKey="Field G">G. D. Field</name>
</author>
<author><name sortKey="Gauthier, J L" uniqKey="Gauthier J">J. L. Gauthier</name>
</author>
<author><name sortKey="Grivich, M I" uniqKey="Grivich M">M. I. Grivich</name>
</author>
<author><name sortKey="Petrusca, D" uniqKey="Petrusca D">D. Petrusca</name>
</author>
<author><name sortKey="Sher, A" uniqKey="Sher A">A. Sher</name>
</author>
<author><name sortKey="Litke, A M" uniqKey="Litke A">A. M. Litke</name>
</author>
<author><name sortKey="Chichilnisky, E J" uniqKey="Chichilnisky E">E. J. Chichilnisky</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Smith, P L" uniqKey="Smith P">P. L. Smith</name>
</author>
<author><name sortKey="Ratcliff, R" uniqKey="Ratcliff R">R. Ratcliff</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Stewart, N" uniqKey="Stewart N">N. Stewart</name>
</author>
<author><name sortKey="Brown, G D A" uniqKey="Brown G">G. D. A. Brown</name>
</author>
<author><name sortKey="Chater, N" uniqKey="Chater N">N. Chater</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Stuttgen, M C" uniqKey="Stuttgen M">M. C. Stüttgen</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Stuttgen, M C" uniqKey="Stuttgen M">M. C. Stüttgen</name>
</author>
<author><name sortKey="Ruter, J" uniqKey="Ruter J">J. Rüter</name>
</author>
<author><name sortKey="Schwarz, C" uniqKey="Schwarz C">C. Schwarz</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Stuttgen, M C" uniqKey="Stuttgen M">M. C. Stüttgen</name>
</author>
<author><name sortKey="Schwarz, C" uniqKey="Schwarz C">C. Schwarz</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Stuttgen, M C" uniqKey="Stuttgen M">M. C. Stüttgen</name>
</author>
<author><name sortKey="Schwarz, C" uniqKey="Schwarz C">C. Schwarz</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Stuttgen, M C" uniqKey="Stuttgen M">M. C. Stüttgen</name>
</author>
<author><name sortKey="Yildiz, A" uniqKey="Yildiz A">A. Yildiz</name>
</author>
<author><name sortKey="Gunturkun, O" uniqKey="Gunturkun O">O. Güntürkün</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Swets, J A" uniqKey="Swets J">J. A. Swets</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Swets, J A" uniqKey="Swets J">J. A. Swets</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Swets, J A" uniqKey="Swets J">J. A. Swets</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Swets, J A" uniqKey="Swets J">J. A. Swets</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Swets, J A" uniqKey="Swets J">J. A. Swets</name>
</author>
<author><name sortKey="Tanner, W P" uniqKey="Tanner W">W. P. Tanner</name>
</author>
<author><name sortKey="Birdsall, T G" uniqKey="Birdsall T">T. G. Birdsall</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Tanner, W P" uniqKey="Tanner W">W. P. Tanner</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Tanner, W P" uniqKey="Tanner W">W. P. Tanner</name>
</author>
<author><name sortKey="Swets, J A" uniqKey="Swets J">J. A. Swets</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Teichert, T" uniqKey="Teichert T">T. Teichert</name>
</author>
<author><name sortKey="Ferrara, V P" uniqKey="Ferrara V">V. P. Ferrara</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Tolhurst, D J" uniqKey="Tolhurst D">D. J. Tolhurst</name>
</author>
<author><name sortKey="Movshon, J A" uniqKey="Movshon J">J. A. Movshon</name>
</author>
<author><name sortKey="Dean, A F" uniqKey="Dean A">A. F. Dean</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Treisman, M" uniqKey="Treisman M">M. Treisman</name>
</author>
<author><name sortKey="Williams, T C" uniqKey="Williams T">T. C. Williams</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Treue, S" uniqKey="Treue S">S. Treue</name>
</author>
<author><name sortKey="Martinez Trujillo, J C" uniqKey="Martinez Trujillo J">J. C. Martinez Trujillo</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Uka, T" uniqKey="Uka T">T. Uka</name>
</author>
<author><name sortKey="Deangelis, G C" uniqKey="Deangelis G">G. C. DeAngelis</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Ulrich, R" uniqKey="Ulrich R">R. Ulrich</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Ulrich, R" uniqKey="Ulrich R">R. Ulrich</name>
</author>
<author><name sortKey="Vorberg, D" uniqKey="Vorberg D">D. Vorberg</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Vallbo, A B" uniqKey="Vallbo A">A. B. Vallbo</name>
</author>
<author><name sortKey="Olsson, K A" uniqKey="Olsson K">K. A. Olsson</name>
</author>
<author><name sortKey="Westberg, K G" uniqKey="Westberg K">K. G. Westberg</name>
</author>
<author><name sortKey="Clark, F J" uniqKey="Clark F">F. J. Clark</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Verplanck, W S" uniqKey="Verplanck W">W. S. Verplanck</name>
</author>
<author><name sortKey="Collier, G H" uniqKey="Collier G">G. H. Collier</name>
</author>
<author><name sortKey="Cotton, J W" uniqKey="Cotton J">J. W. Cotton</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Vogels, R" uniqKey="Vogels R">R. Vogels</name>
</author>
<author><name sortKey="Orban, G A" uniqKey="Orban G">G. A. Orban</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Voigt, B C" uniqKey="Voigt B">B. C. Voigt</name>
</author>
<author><name sortKey="Brecht, M" uniqKey="Brecht M">M. Brecht</name>
</author>
<author><name sortKey="Houweling, A R" uniqKey="Houweling A">A. R. Houweling</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Von Heimendahl, M" uniqKey="Von Heimendahl M">M. von Heimendahl</name>
</author>
<author><name sortKey="Itskov, P M" uniqKey="Itskov P">P. M. Itskov</name>
</author>
<author><name sortKey="Arabzadeh, E" uniqKey="Arabzadeh E">E. Arabzadeh</name>
</author>
<author><name sortKey="Diamond, M E" uniqKey="Diamond M">M. E. Diamond</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Wichmann, F A" uniqKey="Wichmann F">F. A. Wichmann</name>
</author>
<author><name sortKey="Hill, N J" uniqKey="Hill N">N. J. Hill</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Wichmann, F A" uniqKey="Wichmann F">F. A. Wichmann</name>
</author>
<author><name sortKey="Hill, N J" uniqKey="Hill N">N. J. Hill</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Wolfe, J M" uniqKey="Wolfe J">J. M. Wolfe</name>
</author>
<author><name sortKey="Van Wert, M J" uniqKey="Van Wert M">M. J. Van Wert</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Yeshurun, Y" uniqKey="Yeshurun Y">Y. Yeshurun</name>
</author>
<author><name sortKey="Carrasco, M" uniqKey="Carrasco M">M. Carrasco</name>
</author>
<author><name sortKey="Maloney, L T" uniqKey="Maloney L">L. T. Maloney</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Yizhar, O" uniqKey="Yizhar O">O. Yizhar</name>
</author>
<author><name sortKey="Fenno, L E" uniqKey="Fenno L">L. E. Fenno</name>
</author>
<author><name sortKey="Davidson, T J" uniqKey="Davidson T">T. J. Davidson</name>
</author>
<author><name sortKey="Mogri, M" uniqKey="Mogri M">M. Mogri</name>
</author>
<author><name sortKey="Deisseroth, K" uniqKey="Deisseroth K">K. Deisseroth</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Zohary, E" uniqKey="Zohary E">E. Zohary</name>
</author>
<author><name sortKey="Shadlen, M N" uniqKey="Shadlen M">M. N. Shadlen</name>
</author>
<author><name sortKey="Newsome, W T" uniqKey="Newsome W">W. T. Newsome</name>
</author>
</analytic>
</biblStruct>
</listBibl>
</div1>
</back>
</TEI>
<pmc article-type="review-article"><pmc-dir>properties open_access</pmc-dir>
<front><journal-meta><journal-id journal-id-type="nlm-ta">Front Neurosci</journal-id>
<journal-id journal-id-type="publisher-id">Front. Neurosci.</journal-id>
<journal-title-group><journal-title>Frontiers in Neuroscience</journal-title>
</journal-title-group>
<issn pub-type="ppub">1662-4548</issn>
<issn pub-type="epub">1662-453X</issn>
<publisher><publisher-name>Frontiers Research Foundation</publisher-name>
</publisher>
</journal-meta>
<article-meta><article-id pub-id-type="pmid">22084627</article-id>
<article-id pub-id-type="pmc">3212738</article-id>
<article-id pub-id-type="doi">10.3389/fnins.2011.00125</article-id>
<article-categories><subj-group subj-group-type="heading"><subject>Neuroscience</subject>
<subj-group><subject>Review Article</subject>
</subj-group>
</subj-group>
</article-categories>
<title-group><article-title>Mapping Spikes to Sensations</article-title>
</title-group>
<contrib-group><contrib contrib-type="author"><name><surname>Stüttgen</surname>
<given-names>Maik C.</given-names>
</name>
<xref ref-type="aff" rid="aff1"><sup>1</sup>
</xref>
<xref ref-type="author-notes" rid="fn001">*</xref>
</contrib>
<contrib contrib-type="author"><name><surname>Schwarz</surname>
<given-names>Cornelius</given-names>
</name>
<xref ref-type="aff" rid="aff2"><sup>2</sup>
</xref>
<xref ref-type="aff" rid="aff3"><sup>3</sup>
</xref>
</contrib>
<contrib contrib-type="author"><name><surname>Jäkel</surname>
<given-names>Frank</given-names>
</name>
<xref ref-type="aff" rid="aff4"><sup>4</sup>
</xref>
</contrib>
</contrib-group>
<aff id="aff1"><sup>1</sup>
<institution>Department of Biopsychology, University of Bochum</institution>
<country>Bochum, Germany</country>
</aff>
<aff id="aff2"><sup>2</sup>
<institution>Systems Neurophysiology, Werner Reichardt Centre for Integrative Neuroscience, University of Tübingen</institution>
<country>Tübingen, Germany</country>
</aff>
<aff id="aff3"><sup>3</sup>
<institution>Department of Cognitive Neurology, Hertie Institute for Clinical Brain Research, University of Tübingen</institution>
<country>Tübingen, Germany</country>
</aff>
<aff id="aff4"><sup>4</sup>
<institution>Institute of Cognitive Science, University of Osnabrück</institution>
<country>Osnabrück, Germany</country>
</aff>
<author-notes><fn fn-type="edited-by"><p>Edited by: Tobias Kalenscher, Heinrich-Heine University Duesseldorf, Germany</p>
</fn>
<fn fn-type="edited-by"><p>Reviewed by: Floris P. De Lange, Radboud University Nijmegen, Netherlands; Matthijs (Matt) Van Der Meer, University of Waterloo, Canada</p>
</fn>
<corresp id="fn001">*Correspondence: Maik C. Stüttgen, Department of Biopsychology, University of Bochum, Bochum, Germany. e-mail: <email>maik.stuettgen@rub.de</email>
</corresp>
<fn fn-type="other" id="fn002"><p>This article was submitted to Frontiers in Decision Neuroscience, a specialty of Frontiers in Neuroscience.</p>
</fn>
</author-notes>
<pub-date pub-type="epreprint"><day>04</day>
<month>10</month>
<year>2011</year>
</pub-date>
<pub-date pub-type="epub"><day>10</day>
<month>11</month>
<year>2011</year>
</pub-date>
<pub-date pub-type="collection"><year>2011</year>
</pub-date>
<volume>5</volume>
<elocation-id>125</elocation-id>
<history><date date-type="received"><day>09</day>
<month>9</month>
<year>2011</year>
</date>
<date date-type="accepted"><day>14</day>
<month>10</month>
<year>2011</year>
</date>
</history>
<permissions><copyright-statement>Copyright © 2011 Stüttgen, Schwarz and Jäkel.</copyright-statement>
<copyright-year>2011</copyright-year>
<license license-type="open-access" xlink:href="http://www.frontiersin.org/licenseagreement"><license-p>This is an open-access article subject to a non-exclusive license between the authors and Frontiers Media SA, which permits use, distribution and reproduction in other forums, provided the original authors and source are credited and other Frontiers conditions are complied with.</license-p>
</license>
</permissions>
<abstract><p>Single-unit recordings conducted during perceptual decision-making tasks have yielded tremendous insights into the neural coding of sensory stimuli. In such experiments, detection or discrimination behavior (the psychometric data) is observed in parallel with spike trains in sensory neurons (the neurometric data). Frequently, candidate neural codes for information read-out are pitted against each other by transforming the neurometric data in some way and asking which code’s performance most closely approximates the psychometric performance. The code that matches the psychometric performance best is retained as a viable candidate and the others are rejected. In following this strategy, psychometric data is often considered to provide an unbiased measure of perceptual sensitivity. It is rarely acknowledged that psychometric data result from a complex interplay of sensory and non-sensory processes and that neglect of these processes may result in misestimating psychophysical sensitivity. This again may lead to erroneous conclusions regarding the adequacy of candidate neural codes. In this review, we first discuss requirements on the neural data for a subsequent neurometric-psychometric comparison. We then focus on different psychophysical tasks for the assessment of detection and discrimination performance and the cognitive processes that may underlie their execution. We discuss further factors that may compromise psychometric performance and how they can be detected or avoided. We believe that these considerations point to shortcomings in our understanding of the processes underlying perceptual decisions, and therefore offer potential for future research.</p>
</abstract>
<kwd-group><kwd>psychophysics</kwd>
<kwd>perception</kwd>
<kwd>signal detection theory</kwd>
<kwd>psychometric</kwd>
<kwd>neurometric</kwd>
<kwd>receiver operating characteristic</kwd>
<kwd>psychophysical task</kwd>
<kwd>single-unit electrophysiology</kwd>
</kwd-group>
<counts><fig-count count="6"></fig-count>
<table-count count="2"></table-count>
<equation-count count="0"></equation-count>
<ref-count count="139"></ref-count>
<page-count count="17"></page-count>
<word-count count="16194"></word-count>
</counts>
</article-meta>
</front>
<body><sec><title>Introduction</title>
<p>Gustav Theodor Fechner is best known as the founding father of psychophysics. It is perhaps less well known that Fechner distinguished between what he called “outer psychophysics”, the relationship between physical stimuli and sensation, and “inner psychophysics”, the relationship between (neuro-) physiological activity and sensation. While being successful at making outer psychophysics the cornerstone of the evolving science of psychology, physiological methods at his time were not developed enough to allow direct investigation of inner psychophysics, and Fechner was well aware of this limitation (Fechner, <xref ref-type="bibr" rid="B27">1860</xref>
; Baird and Noma, <xref ref-type="bibr" rid="B4">1978</xref>
).</p>
<p>This situation has changed dramatically in the meantime, mainly with the advent of the awake behaving monkey preparation (Evarts, <xref ref-type="bibr" rid="B26">1966</xref>
), which allows for the simultaneous assessment of psychophysical measurements (psychometric data, e.g., percent correct responses) and spikes from (mostly cortical) single neurons in sensory areas of the brain (neurometric data; e.g., Newsome et al., <xref ref-type="bibr" rid="B75">1989</xref>
; Mountcastle et al., <xref ref-type="bibr" rid="B73">1990</xref>
; Vogels and Orban, <xref ref-type="bibr" rid="B131">1990</xref>
). These seminal studies, as well as a multitude of studies published since then, have centered around neurometric–psychometric (NP) comparisons in the sense that some measure of performance quality (such as a detection threshold or a difference limen) is extracted from the neuro- and the psychometric data for direct comparison on the same scale (reviewed in Parker and Newsome, <xref ref-type="bibr" rid="B85">1998</xref>
). In concert with the application of signal detection theory (SDT, Green and Swets, <xref ref-type="bibr" rid="B42">1966</xref>
) to neurometric data, these studies have provided striking evidence that the stimulus detection and discrimination capacity of single sensory neurons can be close to or even exceed the capacity of the entire organism. These findings are in agreement with Barlow’s (<xref ref-type="bibr" rid="B5">1961</xref>
) notion of redundancy reduction: Barlow postulated that the neuronal representation of stimulus information (i.e., the representation relevant for Fechner’s inner psychophysics) must be efficient (Barlow, <xref ref-type="bibr" rid="B5">1961</xref>
, <xref ref-type="bibr" rid="B6">1972</xref>
); in other words, as few spikes as possible in as few neurons as possible should be used to encode a sensory stimulus, a tenet quite different to Sherrington’s (<xref ref-type="bibr" rid="B104">1940</xref>
) idea of the brain as “a million-fold democracy”, in which each citizen (neuron) counts for little.</p>
<p>The NP comparison has realized Fechner’s dream of “inner psychophysics” – relating neurophysiological activity to sensation. However, the precise nature of this relationship is still far from clear. There are a variety of unresolved questions, among them:</p>
<list list-type="simple"><list-item><label>(1)</label>
<p>What is the role of single neurons in the representation of information? This question is closely related to the discriminability of a given set of stimuli by single neurons’ responses. Whether a neuron’s discriminability is to be considered high or low can be most meaningfully assessed if viewed relative to psychophysical performance (Stüttgen, <xref ref-type="bibr" rid="B110">2010</xref>
). High discriminability of single neurons is a prerequisite for sparse coding; thus, it can constrain theories on how information is represented in a given brain area (such as response pooling or the lower envelope principle; Parker and Newsome, <xref ref-type="bibr" rid="B85">1998</xref>
). This, in turn, relates closely to Barlow’s (<xref ref-type="bibr" rid="B6">1972</xref>
) notions about the efficiency of neuronal representations.</p>
</list-item>
<list-item><label>(2)</label>
<p>What neural code is used for stimulus representation? NP comparisons can be used to compare psychometric to neurometric performance based on different candidate codes. For instance, it has been found that two candidate codes, firing rate and firing periodicity, both carry ample information about vibrotactile stimuli (Hernandez et al., <xref ref-type="bibr" rid="B49">2000</xref>
; Arabzadeh et al., <xref ref-type="bibr" rid="B3">2006</xref>
). The code with a neurometric performance that best matches the performance of the observers is then typically assumed to be the one that is used by the brain (e.g. Salinas et al., <xref ref-type="bibr" rid="B100">2000</xref>
; Luna et al., <xref ref-type="bibr" rid="B66">2005</xref>
). More systematic approaches try to assess “complete” neuronal populations (see below) and pit candidate codes against each other. Whenever some code’s performance, computed in a statistically optimal fashion, falls short of the subjects’ psychometric performance, that neuronal code can be rejected (Jacobs et al., <xref ref-type="bibr" rid="B53">2009</xref>
).</p>
</list-item>
<list-item><label>(3)</label>
<p>How is sensory information exploited for perceptual decision-making? Aside from the question of sensory processing, perceptual decision-making encompasses the problem of how sensory information is put to use for adaptive action (Gold and Shadlen, <xref ref-type="bibr" rid="B37">2001</xref>
, <xref ref-type="bibr" rid="B38">2007</xref>
). For example, monkeys do not make use of all stimulus information available to them, but rather commit to action prior to stimulus termination, thereby ignoring useful information (Roitman and Shadlen, <xref ref-type="bibr" rid="B95">2002</xref>
; see also Resulaj et al., <xref ref-type="bibr" rid="B92">2009</xref>
). Also, psychophysical performance is frequently not solely determined by sensory processes but by a range of biasing factors, among them recent stimulus and reward history (Boneau et al., <xref ref-type="bibr" rid="B12">1965</xref>
; Busse et al., <xref ref-type="bibr" rid="B16">2011</xref>
).</p>
</list-item>
</list>
<p>Importantly, the validity of claims about coding schemes on the single-neuron and population level hinges crucially on the precise assessment of the sensory limits of the observer, i.e., psychophysical sensitivity. While great effort has been devoted to the study of neural coding at both the level of individual neurons and neural populations (e.g., Bialek et al., <xref ref-type="bibr" rid="B7">1991</xref>
; Shadlen et al., <xref ref-type="bibr" rid="B103">1996</xref>
; de Ruyter van Steveninck et al., <xref ref-type="bibr" rid="B23">1997</xref>
; Riehle et al., <xref ref-type="bibr" rid="B93">1997</xref>
; Gold and Shadlen, <xref ref-type="bibr" rid="B38">2007</xref>
; Jacobs et al., <xref ref-type="bibr" rid="B53">2009</xref>
), we believe that research aimed at the understanding of the cognitive processes underlying performance in a given psychophysical task has been comparatively neglected by the community. As we will argue below, this could have led to a systematic underestimation of psychophysical sensitivity of animal subjects and, consequently, to an overestimation of neurometric relative to psychometric sensitivity.</p>
<p>In the remainder of the article, we will first review problems in acquiring neurometric data suitable for NP comparisons, a prime focus of research in the last 20 years. Then, turning toward the problem of measuring the psychometric function, we will introduce signal detection theoretical “process models”, i.e., models of the sequence of cognitive steps underlying performance in these tasks. We will discuss additional factors affecting psychophysical performance not accounted for by such process models. We argue that, in order to gain further insight into the physiology of perception, the entire cascade of cognitive processes underlying perceptual decision-making tasks has to be explored.</p>
</sec>
<sec><title>Estimating Neurometric Sensitivity</title>
<p>Conducting an NP comparison poses two distinct problems: the assessment of neurometric sensitivity and the assessment of psychometric sensitivity. In this section, we will first briefly introduce what is meant by an NP comparison. Then, we will discuss problems that arise when attempting to determine psychometric sensitivity.</p>
<p>Figure <xref ref-type="fig" rid="F1">1</xref>
illustrates a simple NP comparison for a yes/no detection task. Several stimuli whose intensities are distributed around the presumed absolute threshold of detectability are presented many times to an observer, whose task is to respond “yes” if he perceives the stimulus and “no” otherwise. As stimulus intensity increases, the proportion of “yes” responses increases as well. The pattern of responses can be fitted by a sigmoidal function. The resulting psychophysical curve is characterized by at least two parameters, the threshold (the point on the abscissa corresponding to 50% detection performance) and the slope of the curve. The term “psychophysical sensitivity” refers to the reciprocal of threshold; thus, the lower the threshold, the higher the sensitivity.</p>
<fig id="F1" position="float"><label>Figure 1</label>
<caption><p><bold>Example illustration of a neurometric–psychometric comparison</bold>
. <bold>(A)</bold>
A typical psychometric curve from a yes/no detection experiment with six stimuli of varying intensity (see Box <xref ref-type="boxed-text" rid="BX1">1</xref>
). Smooth line indicates fit of a cumulative Gaussian to the data points. Dotted line indicates the stimulus value at which the psychometric curve reaches 50% of its final height. This value is commonly taken as the psychophysical threshold. <bold>(B)</bold>
Some typical neurometric curves: a single neuron’s spikes were counted during stimulus presentation. The neuron was assumed to “detect” the event when it fired in excess of <italic>n</italic>
spikes during stimulus presentation, where <italic>n</italic>
here encompasses 1, 2, 4, and 8 spikes. The neurometric curve for <italic>n</italic>
= 2 matches the psychometric curve best, as assessed by their common threshold of 175 (arbitrary units). Thus, the NP ratio here is 175/175 = 1.</p>
</caption>
<graphic xlink:href="fnins-05-00125-g001"></graphic>
</fig>
<p>Imagine that, while the observer was performing the task, a sensory neuron of his is recorded, and its spike responses during stimulus presentation are counted. Neurometric curves can be constructed in a simple way by determining the proportion of stimulus presentation trials on which the neuron fired more than <italic>n</italic>
spikes (i.e., the neuron is deemed to detect the event when more than <italic>n</italic>
spikes are fired during stimulus presentation). Figure <xref ref-type="fig" rid="F1">1</xref>
B displays the results of this exercise for <italic>n</italic>
comprising 1, 2, 4, and 8 spikes. It is readily visible that the curve constructed with a criterion of <italic>n</italic>
= 2 resembles the psychometric curve best in terms of both threshold and slope. In fact, psychometric and neurometric threshold (for <italic>n</italic>
= 2) are identical in this example, and the NP ratio therefore equals 1. Of course, there are considerably more ways to construct neurometric curves, perhaps most notably receiver-operating characteristic (ROC) analysis (Vogels and Orban, <xref ref-type="bibr" rid="B131">1990</xref>
; Britten et al., <xref ref-type="bibr" rid="B15">1992</xref>
), which compares distributions of spike counts for pairs of stimuli and returns the maximum classification performance. There exists a variety of population coding schemes beyond simple spike counts, involving spike timing, spike correlations within (Jacobs et al., <xref ref-type="bibr" rid="B53">2009</xref>
), and between spike trains of different neurons (Zohary et al., <xref ref-type="bibr" rid="B139">1994</xref>
; Shadlen et al., <xref ref-type="bibr" rid="B103">1996</xref>
; Schneidman et al., <xref ref-type="bibr" rid="B101">2006</xref>
; Shlens et al., <xref ref-type="bibr" rid="B107">2006</xref>
, <xref ref-type="bibr" rid="B106">2009</xref>
; Ohiorhenuan et al., <xref ref-type="bibr" rid="B83">2010</xref>
).</p>
<p>Obviously, NP comparisons require two different kinds of measurement – estimating psychometric and neurometric sensitivity. We will have more to say about psychometric sensitivity below. For now, we focus on two important preconditions for the assessment of neurometric sensitivity: causality and completeness. Naturally, in order to make meaningful NP comparisons, the sensory neurons under investigation must be involved in the psychophysical task at hand, i.e., neural activity of these neurons must be causally related to psychophysical performance. The neurometric signals entering the NP comparison should be necessary and, ideally, also sufficient to explain the sensory-driven aspects of the behavior. This requires to record from an “informational bottleneck”, i.e., a neural structure through which all relevant signals pass and which does not receive feedback signals from downstream structures. This way, a clear identification of cause and effect is possible. Unfortunately, such informational bottlenecks are rarely to be found, one notable exception being retinal ganglion cells (Jacobs et al., <xref ref-type="bibr" rid="B53">2009</xref>
). In the central nervous system, the direction of signal flow in ascending sensory pathways is ambiguous. With very few exceptions, subsequent levels of processing are interconnected in a bidirectional way. Also, circular connectivity often bypasses stations on the ascending pathways (e.g., cortical feedback of brain stem centers bypassing thalamic stations; Furuta et al., <xref ref-type="bibr" rid="B33">2010</xref>
). These problems exacerbate in the neocortex where neurons are intricately interconnected – to their neighbors as well as to a multitude of distant neurons residing in other areas. Thus, a close look at the detailed connectivity of sensory systems blurs the notion of an “ascending pathway.” Instead, sensory systems seem to be described better as complex networks, which receive signals at one point and output signals at another with reverberating signal flow in-between. In conclusion, informational bottlenecks, furnishing completeness, and causality, are difficult to define in the central nervous system. Alternatively, a causal contribution of a neuronal structure can be demonstrated by showing that the behavior is blocked/evoked by lesions/electrical stimulation of the structure in question (Parker and Newsome, <xref ref-type="bibr" rid="B85">1998</xref>
). A cautionary note is in order, however, as psychophysical performance can readily be impaired by blocking structures located downstream from the ones actually performing the critical (sensory) computation; in this case, performance degradation may be due to, e.g., response confusion rather than abolition of the sensory function proper. Furthermore, abolishment of a function may result from disrupting non-specific modulatory structures with no contribution to encode or compute the concrete signals under observation. Also, parallel processing of sensory information along a different sensory pathway cannot be ruled out by this strategy; in the latter case, psychometric performance would depend on two or more structures, and the relation between neurons and sensation cannot be pinned down since the relative importance of the structures is not known.</p>
<p>Yet another strategy is to artificially “create” informational bottlenecks by presenting point-like stimuli in both space and time (Hecht et al., <xref ref-type="bibr" rid="B47">1942</xref>
; Barlow, <xref ref-type="bibr" rid="B5">1961</xref>
; Sakitt, <xref ref-type="bibr" rid="B99">1972</xref>
; Johansson and Vallbo, <xref ref-type="bibr" rid="B56">1979</xref>
; Vallbo et al., <xref ref-type="bibr" rid="B129">1984</xref>
). Point-like stimuli are attractive for studies of the physiology of perception as they reduce the number of neurons engaged in the task and the time window in which neuronal responses need to be monitored to a well specified minimum. Sakitt (<xref ref-type="bibr" rid="B99">1972</xref>
), for instance, carried this strategy to the extreme as she studied the difference in visual detection performance evoked by just one photon more. One photon will interact just with one molecule of rhodopsin located in just one photoreceptor. This approach therefore ingeniously related the concept of informational bottleneck to just one cell in the layer of photoreceptors. Using sophisticated psychophysical techniques in humans, Sakitt successfully related a stimulus of “one more photon” to a difference in the subject’s performance, and was thus able to conclude that the action of a single photoreceptor has a significant contribution to perception. A related concept is the attempt to electrically stimulate a single neuron, which has been first realized using electrical stimulation of individual primary afferent fibers in humans (Ochoa and Torebjork, <xref ref-type="bibr" rid="B80">1983</xref>
; Vallbo et al., <xref ref-type="bibr" rid="B129">1984</xref>
). These authors found that subjects perceived the activation of individual tactile nerve fibers in three out of the four classes of fiber types investigated. Some rapidly adapting fibers seem to give rise to a perceptual change with a difference of just one evoked spike. More recently, the technical advent of juxtacellular stimulation made this approach available for the study of the central nervous system (Houweling and Brecht, <xref ref-type="bibr" rid="B51">2008</xref>
; Voigt et al., <xref ref-type="bibr" rid="B132">2008</xref>
). Injecting just about 15 spikes in one neuron in primary somatosensory cortex evoked a measurable difference in detection performance of a rat showing that even single cortical neurons can have an effect on perception. This method bears great promise to be used for systematic mapping of behavioral effects in different stations of a sensory pathway.</p>
<p>Unfortunately, single neuron responses (and thus artificial bottlenecks) cannot be realistically obtained with natural sensory stimuli evolving in space and time, at least in mammalian brains. Even limiting the stimulus in space and time and applying near-threshold intensities, not one but many neurons in primary sensory cortices will get activated (de Lafuente and Romo, <xref ref-type="bibr" rid="B22">2005</xref>
; Stüttgen and Schwarz, <xref ref-type="bibr" rid="B112">2008</xref>
, <xref ref-type="bibr" rid="B113">2010</xref>
). Thus, neither the assessment of a complete informational bottleneck (aside of retinal ganglion cells), nor the creation of an artificial one constituted by a single cell seems attainable. One study in the whisker-related primary somatosensory (barrel) cortex of rats has provided a quantitative hint on the number of neurons engaged vs. the number of neurons needed to match the perceptual performance. Using transient single-whisker deflections at psychophysical threshold, around a third of the stimulations at psychophysical threshold intensity were responded by neurons in the principal barrel cortical column of the stimulated whisker (Stüttgen and Schwarz, <xref ref-type="bibr" rid="B112">2008</xref>
). Thus, alone in the barrel column receiving strongest input of the stimulated whisker (the principal barrel column) around 3000 neurons are active with minimal stimulation. The number of all cells engaged in primary somatosensory cortex is surely far higher because cells in adjacent barrel columns respond as well to single whisker stimuli. On the other hand, the same study found that five of the most sensitive neurons carry sufficient information to explain the psychometric performance. In case the read-out mechanism is less selective, around 16 barrel cortex neurons might be sufficient. In fact, this discrepancy of thousands of cells engaged by the stimulus vs. a few needed to do the job has become a common theme in all studies trying to compare the performance of single neurons to the one of the subject. Since the pioneering studies of Newsome, Movshon, and coworkers in the late 1980s, the single neuron neurometric performance has been found with few exceptions to be close and somewhat lower compared to that of the observer (Tolhurst et al., <xref ref-type="bibr" rid="B123">1983</xref>
; Newsome et al., <xref ref-type="bibr" rid="B75">1989</xref>
; Britten et al., <xref ref-type="bibr" rid="B15">1992</xref>
; Geisler and Albrecht, <xref ref-type="bibr" rid="B35">1997</xref>
; Uka and DeAngelis, <xref ref-type="bibr" rid="B126">2003</xref>
; Purushothaman and Bradley, <xref ref-type="bibr" rid="B90">2005</xref>
; Stüttgen and Schwarz, <xref ref-type="bibr" rid="B112">2008</xref>
; Cohen and Newsome, <xref ref-type="bibr" rid="B20">2009</xref>
).</p>
<p>An outlier result were the findings of the pioneering studies (Britten et al., <xref ref-type="bibr" rid="B15">1992</xref>
; Celebrini and Newsome, <xref ref-type="bibr" rid="B17">1994</xref>
), as neurometric sensitivity was judged up to 10 times higher than the psychometric one. However, this estimate of neurometric sensitivity has been recently adjusted downward by showing that monkeys use only the first few hundred milliseconds of a stimulus, while the neurometric integration time in the original study extended to the full stimulus presentation of 2 s. Thus, the neurons were unfairly favored in the earlier study (Cohen and Newsome, <xref ref-type="bibr" rid="B20">2009</xref>
). In addition, it needs to be pointed out that these pioneers actually based their estimate of the neurometric sensitivity on <italic>two</italic>
neurons, and not (as is often falsely understood) on a single neuron. The neurometric sensitivity was calculated from the measured neuron (selected to display high directionality), combined with a virtual one, the “antineuron”, with opposite direction selectivity but otherwise identical response properties. In fact, the task to discriminate two stimulus directions does not fit well the properties of a single MT neuron, which, due to its high directional selectivity, is limited to convey information about the presence of a stimulus in a single preferred direction, and largely ignores the presence of stimuli in other directions. As a consequence, single MT neuron discriminability to two opposite directions is presumably far lower than claimed in the original study (Britten et al., <xref ref-type="bibr" rid="B15">1992</xref>
). Notably, other studies with the neurometric analysis strategy of postulating antineurons also found considerable fractions of neurons whose sensitivity exceeded that of the observer (MT: Uka and DeAngelis, <xref ref-type="bibr" rid="B126">2003</xref>
; MST: Heuer and Britten, <xref ref-type="bibr" rid="B50">2004</xref>
). A perhaps more suitable psychophysical task to probe the sensitivity of MT neurons would be the detection of movement direction along the neuron’s preferred axis vs. zero net motion, which to our knowledge has not been tried so far. These points hardly diminish the impact of these landmark studies, but they suggest the view that single MT cells are likely to fall in line with neurons in many other sensory areas investigated since then, showing neurometric sensitivities to be somewhat lower than psychometric sensitivity.</p>
<p>With the common finding of NP sensitivity ratios of close to 1 but not exceeding it, it is typically very easy to combine neurometric performance of far fewer neurons than the number suspected (or known) to be engaged in the task to exceed the performance of the subject. Popular responses to this problem have been to postulate (i) sources of noise in downstream processing, (ii) detrimental effects introduced by neuronal correlations, or (iii) intricacies of read-out mechanisms. Despite their value as testable hypotheses, these possibilities must be deemed highly under-constrained without a direct assessment of the complete neuronal population, even though some of them – such as neuronal correlations – have received experimental support (Zohary et al., <xref ref-type="bibr" rid="B139">1994</xref>
; Cohen and Newsome, <xref ref-type="bibr" rid="B19">2008</xref>
).</p>
<p>In conclusion, future NP comparisons are likely to go beyond measurements of spike counts from single units with the aim to identify neuronal population codes. To do this, informational bottlenecks must be studied. The only attainable complete bottleneck in the central nervous system is the population of retinal ganglion cells, which should be further exploited for this purpose. In the peripheral nervous system, somatosensory afferents are equally attractive. Artificial bottlenecks must be extended to activity that evolves in space and time to identify neuronal activity leading to more complex perception. Juxtacellular stimulation of single neurons can be employed to systematically test activity varying over time (Houweling et al., <xref ref-type="bibr" rid="B52">2010</xref>
). Optogenetic approaches, which already allow to interfere with a genetically targeted population of cells, are a promising new tool to achieve this goal with amazing spatiotemporal precision (Yizhar et al., <xref ref-type="bibr" rid="B138">2011</xref>
), even in non-human primates (Diester et al., <xref ref-type="bibr" rid="B24">2011</xref>
).</p>
</sec>
<sec><title>Estimating Psychometric Sensitivity</title>
<p>Sensations are not directly observable in the laboratory. Instead, the subject in a psychophysical experiment (observer) is asked to produce different responses contingent on particular aspects of his sensations. This could be the mere presence or absence of a sensation (stimulus detection), whether two stimuli are perceived to be different (stimulus discrimination), whether a stimulus is a specific one in a set of candidates (identification), or whether a given stimulus belongs to a specific category of stimuli (categorization). In the early days of psychophysics, the behavioral response was simply seen as the effect of a stimulus once its intensity exceeded a sensory threshold. The threshold could be estimated by varying the stimulus intensity and measuring the percentage of correct responses (Figure <xref ref-type="fig" rid="F1">1</xref>
A). However, psychophysical findings varied considerably both across tasks and across laboratories, prompting psychophysicists to develop more reproducible methods (Blackwell, <xref ref-type="bibr" rid="B9">1952</xref>
; Swets, <xref ref-type="bibr" rid="B116">1961a</xref>
,<xref ref-type="bibr" rid="B117">b</xref>
; Swets et al., <xref ref-type="bibr" rid="B119">1961</xref>
). The decision-theoretic stance of SDT (Green and Swets, <xref ref-type="bibr" rid="B42">1966</xref>
) alerted experimenters to the fact that psychophysical measurements hinge crucially on non-sensory factors, among them prior probabilities, payoffs, and task strategy, thus recognizing the active role of the observer. Importantly, SDT’s main index of psychophysical sensitivity (<italic>d</italic>
′) promised improved replicability of results across both tasks and laboratories. The ensuing success of SDT yielded a sharp increase in the use of its concepts, such as ROC analysis, across various fields of research (Swets, <xref ref-type="bibr" rid="B118">1973</xref>
). The power of these ideas is reflected also in the measurement of neurometric data. When comparing them to psychometric data, neurometric discriminability is often measured by ROC analysis (Vogels and Orban, <xref ref-type="bibr" rid="B131">1990</xref>
; Britten et al., <xref ref-type="bibr" rid="B15">1992</xref>
, <xref ref-type="bibr" rid="B14">1996</xref>
; Parker and Newsome, <xref ref-type="bibr" rid="B85">1998</xref>
). If decisional factors play a role for the behavioral response in psychophysical tasks, it is reasonable to deploy their manipulation for the study of perceptual processes. As a consequence, the focus in the last decade has shifted away from neuronal sensitivity toward the study of perceptual decision-making. It is now asked how and to what degree sensory representations also reflect the behavioral choice (Britten et al., <xref ref-type="bibr" rid="B14">1996</xref>
; Romo and Salinas, <xref ref-type="bibr" rid="B97">2003</xref>
; Gold and Shadlen, <xref ref-type="bibr" rid="B38">2007</xref>
; Nienborg and Cumming, <xref ref-type="bibr" rid="B79">2009</xref>
, <xref ref-type="bibr" rid="B76">2010</xref>
). A more recent development has been to go beyond varying stimulus parameters and explicitly vary payoffs and/or the frequency of the stimuli to study directly how representations of stimulus and choice correspond and interact (Feng et al., <xref ref-type="bibr" rid="B29">2009</xref>
; Rorie et al., <xref ref-type="bibr" rid="B98">2010</xref>
; Teichert and Ferrara, <xref ref-type="bibr" rid="B122">2010</xref>
; Stüttgen et al., <xref ref-type="bibr" rid="B114">2011</xref>
).</p>
<p>Despite these developments, the psychophysical task – at least when used to measure neuronal sensitivities – has, by and large, been considered merely a means to measure responses. Typically, the minimization of extra-sensory factors is considered as a given. Against the backdrop of the insights gained by SDT half a century ago about the psychological nature of even the simplest sensory detection tasks, it gives cause of concern how little possible effects of extra-sensory factors on the psychometric curve are discussed. Our goal in this review is to remind the reader that all parameters of the psychometric curve depend on the detailed procedure and will, thus, significantly affect the estimation of psychometric sensitivity and thereby the NP ratio. Each psychophysical task comes with different memory requirements, constraints on information processing, and effects on motivation and bias that limit the use of sensory information. In order to study how sensory information processing works – even at the sensor level – ultimately these more “psychological” factors have to be taken into account. We will start with a brief review of SDT and an analysis of cognitive processes underlying performance in commonly employed psychophysical tasks. Then, we will discuss additional non-stimulus factors outside the SDT framework that may significantly influence the subject’s responses.</p>
<sec><title>SDT analysis of the yes/no task</title>
<p>The vast majority of researchers undertaking the NP comparison employ Go–NoGo (GNG), yes/no (YN), or Forced-Choice (FC) tasks (see Box <xref ref-type="boxed-text" rid="BX1">1</xref>
, Table <xref ref-type="table" rid="T1">1</xref>
, and Figure <xref ref-type="fig" rid="F2">2</xref>
for brief descriptions of these and some other psychophysical tasks). SDT offers a broad conceptual framework for the analysis of different psychophysical tasks. Here, we will illustrate SDT concepts mainly with YN and FC. The interested reader is referred to MacMillan and Creelman (<xref ref-type="bibr" rid="B68">2005</xref>
) for further paradigms and discussion.</p>
<boxed-text id="BX1" position="float"><label>Box 1</label>
<caption><title>Description of psychophysical tasks</title>
</caption>
<p><bold>Go</bold>
–<bold>NoGo (GNG)</bold>
</p>
<p>The observer has one response option <italic>R</italic>
available (e.g., pressing or releasing a lever, performing a nose poke, or pecking a response key) and is required to respond when a stimulus of class A is presented and not to respond when a stimulus of class B is presented. The outline of a typical trial is depicted in Figure <xref ref-type="fig" rid="F2">2</xref>
A. After an inter-trial interval (ITI), a stimulus is presented. If the subject responds within a given time frame (the “response window”) after target onset, reward is delivered; in case of a response after a non-target stimulus, punishment is delivered.</p>
<p>The biggest advantage of the GNG method is its simplicity. Animals are easily trained on GNG using intense, suprathreshold stimuli. Consequently, the intensity difference between the stimuli in classes A and B is gradually reduced, until no further improvement is possible (see Schwarz et al., <xref ref-type="bibr" rid="B102">2010</xref>
, for a methods review). Then, presenting a pseudorandom sequence of several stimuli (“method of constant stimuli”), the response probability for each stimulus is recorded, and a psychometric curve can be constructed (detection: Stüttgen et al., <xref ref-type="bibr" rid="B111">2006</xref>
, discrimination: Gerdjikov et al., <xref ref-type="bibr" rid="B36">2010</xref>
).</p>
<p>Note that this description refers to an instantiation of the yes/no task (a single stimulus per trial) in the form of a Go–NoGo paradigm. Of course, GNG can also be conducted with two stimuli per trial as in two-interval forced choice (see below).</p>
<p><bold>Yes/no</bold>
<bold>(YN; also known as A Not-A or single-interval forced choice)</bold>
</p>
<p>The observer has two response options <italic>R</italic>
<sub>A</sub>
and <italic>R</italic>
<sub>B</sub>
available and is required to respond with “<italic>R</italic>
<sub>A</sub>
” when stimulus A is presented and with “<italic>R</italic>
<sub>B</sub>
” when stimulus B is presented. Rather than two individual stimuli, A and B can be classes of stimuli, e.g., leftward and rightward motion of various strengths. The outline of a typical trial is depicted in Figure <xref ref-type="fig" rid="F2">2</xref>
B. After an inter-trial interval (ITI), a stimulus taken from either class A or class B is presented. If the observer emits the appropriate response within a given time frame (response window), reward is delivered; if the incorrect response is emitted, the subject is punished, usually by a brief time-out. In many monkey studies, the response consists in making a saccade to one of two choice targets. The term “yes/no” derives from main usage of the paradigm in studies of stimulus detection in the early days of psychophysics. However, use of the YN method is not limited to detection but is employed in studies of discrimination performance as well. Notably, many neuroscience papers list this paradigm as a “forced-choice task” (e.g., Britten et al., <xref ref-type="bibr" rid="B15">1992</xref>
), or “two-choice task” (Kepecs et al., <xref ref-type="bibr" rid="B57">2008</xref>
). Sometimes the YN-method is referred to as “single-interval forced choice.” Although this terminology has some conceptual appeal, we will avoid this term lest we add to the terminological confusion. Note that, in signal detection theoretical contexts, the YN method is typically understood to employ only two stimuli per block of trials (the consequences of departure from this rule are discussed in the main text). In addition, psychophysicists sometimes refer to a yes/no task with more than two stimuli as the “method of single stimuli.” Here we will use the term “yes/no task” for any task in which a single stimulus is presented per trial and in which the subject has two response options available, regardless of the total number of stimuli in the stimulus set.</p>
<p><bold>Yes/no with reference (YNR)</bold>
</p>
<p>This method is similar to the yes/no task described above with two different stimuli per trial. On each trial, a reference stimulus is presented first; then, a second stimulus (target) is presented. The subject’s task is to judge whether the target stimulus is more or less intense than the reference stimulus along some sensory continuum. The rationale in using YNR is to avoid decrements in performance due to bad recall of the reference stimulus’ features (stimulus uncertainty; see, e.g., Hautus et al., <xref ref-type="bibr" rid="B46">2009</xref>
).</p>
<p><bold>Identification</bold>
</p>
<p>The subject is presented with one of <italic>m</italic>
stimuli in a single interval and has to emit one of <italic>m</italic>
possible responses. Hence, the yes/no method with two stimuli is a special case of an identification task with only two responses. In cases where there are two responses which are not thought of as literally “yes” and “no”, such as leftward vs. rightward motion, identification might be a better term than YN.</p>
<p><bold>Same-different</bold>
</p>
<p>The observer is presented with two stimuli, either simultaneously or in succession, and has to judge whether they are the same or different. The position or the sequence of the two stimuli in a pair is randomized. Unlike YNR, the first stimulus in this task is not identical across trials.</p>
<p><bold>Forced Choice</bold>
</p>
<p>This task can take many forms. In the most common application (the “<italic>n</italic>
-interval forced choice task”, <italic>n</italic>
-IFC), there are <italic>n</italic>
stimuli on each trial, and the observer has to choose a target out of <italic>n</italic>
− 1 distractor stimuli. In tactile psychophysics, a common implementation is the two-interval forced choice task (2-IFC, e.g., Luna et al., <xref ref-type="bibr" rid="B66">2005</xref>
; Figure <xref ref-type="fig" rid="F2">2</xref>
C). Here, a stimulus is presented for a brief interval of time (e.g., 1 s), which is followed by a short inter-stimulus interval, and the presentation of a second stimulus. The subject has to decide which of the two stimuli the target is (e.g., which stimulus is of larger intensity or higher frequency). If 2-IFC is used to assess detection performance, one of the stimuli is the null stimulus, the other one is the target. Another implementation of forced choice is the spatial <italic>n</italic>
-alternative forced-choice method (<italic>n</italic>
-AFC, Figure <xref ref-type="fig" rid="F2">2</xref>
D): on each trial, <italic>n</italic>
stimuli are presented on a screen in front of the subject, who has to pick the target stimulus (e.g., Jacobs et al., <xref ref-type="bibr" rid="B53">2009</xref>
; see also Jäkel and Wichmann, <xref ref-type="bibr" rid="B54">2006</xref>
).</p>
<p>Incidentally, FC can also be instantiated as a GNG task, e.g., by asking the subject to respond when it believes the first stimulus to be the target, and to withhold responding when it believes otherwise.</p>
<p><bold>A note on terminology</bold>
</p>
<p>It is important to note the discordant uses of psychophysical terms in the animal neuro-psychophysics and the psychological literature. In forced choice methods (psychological use), the observer is always presented with multiple stimuli per trial, either in temporal succession (<italic>n</italic>
-IFC) or simultaneously (e.g., at different spatial locations, <italic>n-</italic>
AFC). An inconsistency of this terminology is that YN tasks are not commonly called FC, although they do feature a forced choice component (they require the observer to emit one of two responses on each trial). This is probably the reason why animal studies often call YN tasks FC, bearing the danger that characteristics of the different tasks that critically relate to the comparison of neurometric and psychometric data slip out of focus and get neglected (see main text). Here we adopt the psychological terminology (which is consistent with signal detection theory, see also Section 2.3.5 in Kingdom and Prins, <xref ref-type="bibr" rid="B59">2010</xref>
), despite the mentioned inconsistency; accordingly, many of the paradigms called “forced choice” in the neuroscience literature are referred to as yes/no method in the present review.</p>
</boxed-text>
<table-wrap id="T1" position="float"><label>Table 1</label>
<caption><p><bold>Overview over the most frequently used tasks in animal psychophysics and their properties</bold>
.</p>
</caption>
<table frame="hsides" rules="groups"><thead><tr><th valign="top" align="left" rowspan="1" colspan="1"></th>
<th valign="top" align="left" rowspan="1" colspan="1">Number of stimuli per trial</th>
<th valign="top" align="left" rowspan="1" colspan="1">Number of response options</th>
<th valign="top" align="left" rowspan="1" colspan="1">Working memory for stimulus required?</th>
<th valign="top" colspan="3" align="center" rowspan="1">Susceptibility to bias<hr></hr>
</th>
<th valign="top" align="left" rowspan="1" colspan="1">Example for a putative process model</th>
<th valign="top" align="left" rowspan="1" colspan="1">Example studies</th>
</tr>
<tr><th valign="top" align="left" rowspan="1" colspan="1"></th>
<th valign="top" align="left" rowspan="1" colspan="1"></th>
<th valign="top" align="left" rowspan="1" colspan="1"></th>
<th valign="top" align="left" rowspan="1" colspan="1"></th>
<th valign="top" align="left" rowspan="1" colspan="1">Motor</th>
<th valign="top" align="left" rowspan="1" colspan="1">Interval</th>
<th valign="top" align="left" rowspan="1" colspan="1">Motivation</th>
<th valign="top" align="left" rowspan="1" colspan="1"></th>
<th valign="top" align="left" rowspan="1" colspan="1"></th>
</tr>
</thead>
<tbody><tr><td valign="top" align="left" rowspan="1" colspan="1">Go–NoGo</td>
<td valign="top" align="left" rowspan="1" colspan="1">1 (but may vary)</td>
<td valign="top" align="left" rowspan="1" colspan="1">1</td>
<td valign="top" align="left" rowspan="1" colspan="1">No</td>
<td valign="top" align="left" rowspan="1" colspan="1">++</td>
<td valign="top" align="left" rowspan="1" colspan="1">n/a</td>
<td valign="top" align="left" rowspan="1" colspan="1">++</td>
<td valign="top" align="left" rowspan="1" colspan="1">Encode S – compare to C stored in LTM – decide whether to respond</td>
<td valign="top" align="left" rowspan="1" colspan="1">Cook and Maunsell (<xref ref-type="bibr" rid="B21">2002</xref>
), Stüttgen et al. (<xref ref-type="bibr" rid="B111">2006</xref>
), Mehta et al. (<xref ref-type="bibr" rid="B70">2007</xref>
), Palmer et al. (<xref ref-type="bibr" rid="B84">2007</xref>
), Stüttgen and Schwarz (<xref ref-type="bibr" rid="B112">2008</xref>
, <xref ref-type="bibr" rid="B113">2010</xref>
), Gerdjikov et al. (<xref ref-type="bibr" rid="B36">2010</xref>
), O’Connor et al. (<xref ref-type="bibr" rid="B81">2010a</xref>
,<xref ref-type="bibr" rid="B82">b</xref>
), Frederick et al. (<xref ref-type="bibr" rid="B31">2011</xref>
)</td>
</tr>
<tr><td valign="top" align="left" rowspan="1" colspan="1">Yes/no</td>
<td valign="top" align="left" rowspan="1" colspan="1">1</td>
<td valign="top" align="left" rowspan="1" colspan="1">2</td>
<td valign="top" align="left" rowspan="1" colspan="1">No</td>
<td valign="top" align="left" rowspan="1" colspan="1">+</td>
<td valign="top" align="left" rowspan="1" colspan="1">n/a</td>
<td valign="top" align="left" rowspan="1" colspan="1">0</td>
<td valign="top" align="left" rowspan="1" colspan="1">Encode S – compare to C stored in LTM – decide which response to emit</td>
<td valign="top" align="left" rowspan="1" colspan="1">Britten et al. (<xref ref-type="bibr" rid="B15">1992</xref>
, <xref ref-type="bibr" rid="B14">1996</xref>
), Krupa et al. (<xref ref-type="bibr" rid="B62">2001</xref>
), de Lafuente and Romo (<xref ref-type="bibr" rid="B22">2005</xref>
), Frederick et al. (<xref ref-type="bibr" rid="B31">2011</xref>
), von Heimendahl et al. (<xref ref-type="bibr" rid="B133">2007</xref>
)</td>
</tr>
<tr><td valign="top" align="left" rowspan="1" colspan="1">Yes/no with reference</td>
<td valign="top" align="left" rowspan="1" colspan="1">2</td>
<td valign="top" align="left" rowspan="1" colspan="1">2</td>
<td valign="top" align="left" rowspan="1" colspan="1">Depends on strategy</td>
<td valign="top" align="left" rowspan="1" colspan="1">+</td>
<td valign="top" align="left" rowspan="1" colspan="1">n/a</td>
<td valign="top" align="left" rowspan="1" colspan="1">0</td>
<td valign="top" align="left" rowspan="1" colspan="1">Encode R – transfer to WM – encode S – compare S&R – decide</td>
<td valign="top" align="left" rowspan="1" colspan="1">Mountcastle et al. (<xref ref-type="bibr" rid="B73">1990</xref>
), Purushothaman and Bradley (<xref ref-type="bibr" rid="B90">2005</xref>
), Qin et al. (<xref ref-type="bibr" rid="B91">2009</xref>
), also see Lee et al. (<xref ref-type="bibr" rid="B64">2007</xref>
), Hautus et al. (<xref ref-type="bibr" rid="B46">2009</xref>
)</td>
</tr>
<tr><td valign="top" align="left" rowspan="1" colspan="1">Same-different</td>
<td valign="top" align="left" rowspan="1" colspan="1">2</td>
<td valign="top" align="left" rowspan="1" colspan="1">2</td>
<td valign="top" align="left" rowspan="1" colspan="1">Depends on strategy</td>
<td valign="top" align="left" rowspan="1" colspan="1">+</td>
<td valign="top" align="left" rowspan="1" colspan="1">+</td>
<td valign="top" align="left" rowspan="1" colspan="1">0</td>
<td valign="top" align="left" rowspan="1" colspan="1">Encode S1 – transfer to WM – encode S2 – compare – decide</td>
<td valign="top" align="left" rowspan="1" colspan="1">Vogels and Orban (<xref ref-type="bibr" rid="B131">1990</xref>
)</td>
</tr>
<tr><td valign="top" align="left" rowspan="1" colspan="1"><italic>m</italic>
-Interval forced choice</td>
<td valign="top" align="left" rowspan="1" colspan="1">m</td>
<td valign="top" align="left" rowspan="1" colspan="1">m</td>
<td valign="top" align="left" rowspan="1" colspan="1">Yes</td>
<td valign="top" align="left" rowspan="1" colspan="1">+</td>
<td valign="top" align="left" rowspan="1" colspan="1">+</td>
<td valign="top" align="left" rowspan="1" colspan="1">0</td>
<td valign="top" align="left" rowspan="1" colspan="1">For <italic>m</italic>
= 2: encode S1 – transfer to WM – encode S2 – compare – decide</td>
<td valign="top" align="left" rowspan="1" colspan="1">Hernandez et al. (<xref ref-type="bibr" rid="B48">1997</xref>
), Luna et al. (<xref ref-type="bibr" rid="B66">2005</xref>
)</td>
</tr>
<tr><td valign="top" align="left" rowspan="1" colspan="1">Spatial <italic>m</italic>
-alternative forced choice</td>
<td valign="top" align="left" rowspan="1" colspan="1">m</td>
<td valign="top" align="left" rowspan="1" colspan="1">m</td>
<td valign="top" align="left" rowspan="1" colspan="1">No</td>
<td valign="top" align="left" rowspan="1" colspan="1">+</td>
<td valign="top" align="left" rowspan="1" colspan="1">n/a</td>
<td valign="top" align="left" rowspan="1" colspan="1">0</td>
<td valign="top" align="left" rowspan="1" colspan="1">For <italic>m</italic>
= 2: encode S1 and S2 (simultaneously or sequentially?) – compare – decide</td>
<td valign="top" align="left" rowspan="1" colspan="1">Mentzer (<xref ref-type="bibr" rid="B71">1966</xref>
), Knutsen et al. (<xref ref-type="bibr" rid="B61">2006</xref>
), Jacobs et al. (<xref ref-type="bibr" rid="B53">2009</xref>
), Adibi and Arabzadeh (<xref ref-type="bibr" rid="B1">2011</xref>
), Busse et al. (<xref ref-type="bibr" rid="B16">2011</xref>
)</td>
</tr>
</tbody>
</table>
<table-wrap-foot><p><italic>S, stimulus; S1, first stimulus; S2, second stimulus; RM, reminder; C, criterion; WM, working memory; LTM, long-term memory; ++, strong; +, moderate, 0, weak, n/a, not applicable</italic>
.</p>
</table-wrap-foot>
</table-wrap>
<fig id="F2" position="float"><label>Figure 2</label>
<caption><p><bold>Sequence of events in four tasks commonly employed in animal psychophysics</bold>
. <bold>(A)</bold>
Go–NoGo task. <bold>(B)</bold>
Yes/no task. <bold>(C)</bold>
Two-interval forced choice task. <bold>(D)</bold>
Spatial two-alternative forced choice task.</p>
</caption>
<graphic xlink:href="fnins-05-00125-g002"></graphic>
</fig>
<p>Signal detection theory starts with the assumption that each presentation of a signal yields a variable internal representation on a hypothetical decision axis. Similarly, even in the absence of sensory input, the system generates a non-zero, somewhat variable response. In the simplest and most widely used case, the distributions of the internal representation of both stimulus (S) and noise (N) are assumed to be normal and their variances identical (Figure <xref ref-type="fig" rid="F3">3</xref>
).</p>
<fig id="F3" position="float"><label>Figure 3</label>
<caption><p><bold>Signal detection theoretical process model of performance in the yes/no task</bold>
. See main text for details.</p>
</caption>
<graphic xlink:href="fnins-05-00125-g003"></graphic>
</fig>
<p>The task can be conceptualized as a statistical decision problem. The observer is assumed to partition the decision axis into the discrete response options that are available to him: “yes”, a signal was present, and “no”, no signal was present (a similar logic applies to discrimination tasks). On each trial, there are four possible outcomes: (1) a signal is presented, and the observer responds “signal” (hit), (2) a signal is presented, and the observer responds “no signal” (miss), (3) no signal is presented, and the observer responds “signal” (false alarm), and (4) no signal is presented, and the observer responds “no signal” (correct rejection). Cases 1 and 4 are correct responses; cases 2 and 3 are false. Given this experimental setup, a payoff matrix assigns a value to each of the four possible outcomes. Usually, correct responses are equally likely to yield reinforcement, and reinforcers are of the same magnitude for cases 1 and 4. Incorrect responses are usually punished, and again punishments are of the same magnitude for cases 2 and 3. If this is the case, and the stimuli are equally likely to occur, the observer’s optimal (in the sense of maximizing accuracy, and therefore expected payoff) decision criterion is located right in the middle between the two stimulus distributions. Thus, the probability of hits equals that of correct rejections, and the probability of false alarms equals that of misses. The discriminability of the two stimuli, N and S, is given by the difference of means of the two stimulus distributions on the decision variable, divided by the common standard deviation (SD) of the distributions. This measure is called <italic>d</italic>
′. SDT separates sensory discriminability (indexed by <italic>d</italic>
′) and response bias, which is the distance of the decision criterion from a neutral position (a measure called <italic>c</italic>
), and therefore, at least in theory, provides a measure of sensitivity untainted by response bias. This separation is of great value because the usual index of performance in psychophysics, percent correct, is known to be highly susceptible to variations in task structure and response bias (Green and Swets, <xref ref-type="bibr" rid="B42">1966</xref>
).</p>
</sec>
<sec><title>SDT analysis of the two-interval forced choice task</title>
<p>A classic example for how SDT can help relate different psychophysical tasks is the relationship between YN and two-interval forced choice (2-IFC; the same applies to spatial two-alternative forced choice, 2-AFC). In a simple instantiation of 2-IFC, the observer is confronted with two different stimuli per trial; let us assume these are the same two stimuli that have been used previously in the YN task. The observer is presented with both stimuli on each trial, but each stimulus is assigned randomly to one of two successive temporal intervals. The observer’s task is to designate which interval contained the target. Hence, contrary to the YN task, where the subject observes a sample from either the signal or the noise distribution on each trial, here the subject gets one sample from each without knowing which one is presented in which of the two intervals. The optimal strategy in this case is to take the difference between the two values and base the decision on the sign of the difference. Figure <xref ref-type="fig" rid="F4">4</xref>
shows the two distributions that arise when the decision is based on the samples’ difference. They represent the cases when (a) the first interval contained the target (<italic>S</italic>
→ <italic>N</italic>
) and (b) the second interval contained the target (<italic>N</italic>
→ <italic>S</italic>
). In the first case, the distribution of the differences will be centered on the mean of the <italic>S</italic>
distribution minus the mean of the <italic>N</italic>
distribution – thus, the mean difference will be <italic>d</italic>
′ as would be obtained in a yes/no task (henceforth referred to as <inline-formula><mml:math id="M1"><mml:mrow><mml:msubsup><mml:mrow><mml:mi>d</mml:mi>
</mml:mrow>
<mml:mrow><mml:mstyle class="text"><mml:mtext>YN</mml:mtext>
</mml:mstyle>
</mml:mrow>
<mml:mrow><mml:mi>′</mml:mi>
</mml:mrow>
</mml:msubsup>
</mml:mrow>
</mml:math>
</inline-formula>
), with a variance of √2. In the second case, the distribution of the differences will be centered on the mean of <italic>N</italic>
minus the mean of <italic>S</italic>
, again with a variance of √2, but with a mean of <inline-formula><mml:math id="M2"><mml:mrow><mml:mo class="MathClass-bin">-</mml:mo>
<mml:msubsup><mml:mrow><mml:mi>d</mml:mi>
</mml:mrow>
<mml:mrow><mml:mstyle class="text"><mml:mtext>YN</mml:mtext>
</mml:mstyle>
</mml:mrow>
<mml:mrow><mml:mi>′</mml:mi>
</mml:mrow>
</mml:msubsup>
<mml:mo class="MathClass-punc">.</mml:mo>
</mml:mrow>
</mml:math>
</inline-formula>
Consequently, the distance of the two distributions is <inline-formula><mml:math id="M3"><mml:mrow><mml:mn>2</mml:mn>
<mml:msup><mml:mrow></mml:mrow>
<mml:mrow><mml:mstyle class="mbox"><mml:mtext></mml:mtext>
<mml:mstyle class="math"><mml:mo class="MathClass-bin">*</mml:mo>
</mml:mstyle>
<mml:mtext></mml:mtext>
</mml:mstyle>
</mml:mrow>
</mml:msup>
<mml:msubsup><mml:mrow><mml:mi>d</mml:mi>
</mml:mrow>
<mml:mrow><mml:mstyle class="text"><mml:mtext>YN</mml:mtext>
</mml:mstyle>
</mml:mrow>
<mml:mrow><mml:mi>′</mml:mi>
</mml:mrow>
</mml:msubsup>
<mml:mo class="MathClass-punc">.</mml:mo>
</mml:mrow>
</mml:math>
</inline-formula>
However, because of the increased variance, <italic>d</italic>
′ in the 2-IFC task (<inline-formula><mml:math id="M4"><mml:mrow><mml:msubsup><mml:mrow><mml:mi>d</mml:mi>
</mml:mrow>
<mml:mrow><mml:mstyle class="text"><mml:mtext>FC</mml:mtext>
</mml:mstyle>
</mml:mrow>
<mml:mrow><mml:mi>′</mml:mi>
</mml:mrow>
</mml:msubsup>
</mml:mrow>
</mml:math>
</inline-formula>
) is <inline-formula><mml:math id="M5"><mml:mrow><mml:mfrac><mml:mrow><mml:mn>2</mml:mn>
<mml:msup><mml:mrow></mml:mrow>
<mml:mrow><mml:mstyle class="mbox"><mml:mtext></mml:mtext>
<mml:mstyle class="math"><mml:mo class="MathClass-bin">*</mml:mo>
</mml:mstyle>
<mml:mtext></mml:mtext>
</mml:mstyle>
</mml:mrow>
</mml:msup>
<mml:msubsup><mml:mrow><mml:mi>d</mml:mi>
</mml:mrow>
<mml:mrow><mml:mstyle class="text"><mml:mtext>YN</mml:mtext>
</mml:mstyle>
</mml:mrow>
<mml:mrow><mml:mi>′</mml:mi>
</mml:mrow>
</mml:msubsup>
</mml:mrow>
<mml:mrow><mml:mi>√</mml:mi>
<mml:mstyle class="text"><mml:mtext>2</mml:mtext>
</mml:mstyle>
</mml:mrow>
</mml:mfrac>
<mml:mo class="MathClass-rel">=</mml:mo>
<mml:msubsup><mml:mrow><mml:mi>d</mml:mi>
</mml:mrow>
<mml:mrow><mml:mstyle class="text"><mml:mtext>YN</mml:mtext>
</mml:mstyle>
</mml:mrow>
<mml:mrow><mml:mi>′</mml:mi>
</mml:mrow>
</mml:msubsup>
<mml:msup><mml:mrow></mml:mrow>
<mml:mrow><mml:mstyle class="mbox"><mml:mtext></mml:mtext>
<mml:mstyle class="math"><mml:mo class="MathClass-bin">*</mml:mo>
</mml:mstyle>
<mml:mtext></mml:mtext>
</mml:mstyle>
</mml:mrow>
</mml:msup>
<mml:mi>√</mml:mi>
<mml:mstyle class="text"><mml:mtext>2</mml:mtext>
</mml:mstyle>
<mml:mstyle class="text"><mml:mtext>.</mml:mtext>
</mml:mstyle>
</mml:mrow>
</mml:math>
</inline-formula>
Translated to correct performance, if chance performance equals 50%, this corresponds to an increase from 84% to 92% correct if <inline-formula><mml:math id="M6"><mml:mrow><mml:msubsup><mml:mrow><mml:mi>d</mml:mi>
</mml:mrow>
<mml:mrow><mml:mstyle class="text"><mml:mtext>YN</mml:mtext>
</mml:mstyle>
</mml:mrow>
<mml:mrow><mml:mi>′</mml:mi>
</mml:mrow>
</mml:msubsup>
<mml:mo class="MathClass-rel">=</mml:mo>
<mml:mn>1</mml:mn>
<mml:mo class="MathClass-punc">.</mml:mo>
</mml:mrow>
</mml:math>
</inline-formula>
Thus, SDT predicts that an observer (if he adopts the optimal strategy) will have a √2 times higher discriminability (indexed by <inline-formula><mml:math id="M7"><mml:mrow><mml:msubsup><mml:mrow><mml:mi>d</mml:mi>
</mml:mrow>
<mml:mrow><mml:mstyle class="text"><mml:mtext>YN</mml:mtext>
</mml:mstyle>
</mml:mrow>
<mml:mrow><mml:mi>′</mml:mi>
</mml:mrow>
</mml:msubsup>
</mml:mrow>
</mml:math>
</inline-formula>
) in a 2-IFC task than in a YN task with the very same two stimuli, i.e., <inline-formula><mml:math id="M8"><mml:mrow><mml:msubsup><mml:mrow><mml:mi>d</mml:mi>
</mml:mrow>
<mml:mrow><mml:mstyle class="text"><mml:mtext>FC</mml:mtext>
</mml:mstyle>
</mml:mrow>
<mml:mrow><mml:mi>′</mml:mi>
</mml:mrow>
</mml:msubsup>
<mml:mo class="MathClass-rel">=</mml:mo>
<mml:mi>√</mml:mi>
<mml:msup><mml:mrow><mml:mstyle class="text"><mml:mtext>2</mml:mtext>
</mml:mstyle>
</mml:mrow>
<mml:mrow><mml:mo class="MathClass-bin">*</mml:mo>
</mml:mrow>
</mml:msup>
<mml:msubsup><mml:mrow><mml:mi>d</mml:mi>
</mml:mrow>
<mml:mrow><mml:mstyle class="text"><mml:mtext>YN</mml:mtext>
</mml:mstyle>
</mml:mrow>
<mml:mrow><mml:mi>′</mml:mi>
</mml:mrow>
</mml:msubsup>
<mml:mstyle class="text"><mml:mtext>.</mml:mtext>
</mml:mstyle>
</mml:mrow>
</mml:math>
</inline-formula>
Indeed, this prediction was approximately confirmed in some studies (Swets, <xref ref-type="bibr" rid="B115">1959</xref>
) but not in others (Yeshurun et al., <xref ref-type="bibr" rid="B137">2008</xref>
).</p>
<fig id="F4" position="float"><label>Figure 4</label>
<caption><p><bold>Signal detection theoretical process model of performance in the 2-AFC task</bold>
. See main text for details.</p>
</caption>
<graphic xlink:href="fnins-05-00125-g004"></graphic>
</fig>
</sec>
<sec><title>The stimulus set and prior probabilities</title>
<p>In most neurophysiological experiments, animals are presented with more than two stimuli varying in their discriminability. Each pair of stimuli has a specific <italic>d</italic>
′ that can be measured in an YN task as described above. Hence, each stimulus is assumed to give rise to a Gaussian distribution on the decision axis. How should the subject respond if we showed all stimuli randomized in one and the same block of an experiment? In Figure <xref ref-type="fig" rid="F5">5</xref>
A, an observer is confronted with two stimulus categories, S1 and S2. S1 consists of a single stimulus (the noise-only stimulus <italic>N</italic>
), S2 consists of five stimuli (each with a different <italic>d</italic>
′ compared to <italic>N</italic>
). All six stimuli occur with equal probability (1/6) and the subject’s task is to “detect” any stimulus that is greater than S1 in a simple YN task. The rightmost panel illustrates overall proportion of correct responses as a function of criterion placement. The resulting psychometric curve is depicted in Figure <xref ref-type="fig" rid="F5">5</xref>
E (magenta), an example detection study which used such a stimulus set is Stüttgen et al. (<xref ref-type="bibr" rid="B111">2006</xref>
).</p>
<fig id="F5" position="float"><label>Figure 5</label>
<caption><p><bold>Illustration how different stimulus presentation probabilities and different ROC-analysis strategies may yield disparate estimates of sensory performance</bold>
. <bold>(A)</bold>
The total stimulus set comprises six different stimuli, five of which correspond to S2 (gray distributions, blue distribution is the sum of five individual ones) and one corresponds to S1 (red). All six stimuli occur with equal probability (means: 100:10:150) and have identical SD (20). Middle panel: depending on the location of the response criterion on the decision axis, different sets of probabilities of a correct response exist. For each possible criterion on the abscissa, the corresponding accuracies for each stimulus can be read off the ordinate. Right panel: overall proportion of correct responses (across all stimuli) as a function of criterion placement. Vertical line indicates optimal criterion placement. <bold>(B)</bold>
As in <bold>(A)</bold>
, but probability of S1 and S2 are equal (0.5 each); within the S2 category, all stimuli are equally probable (p = 0.1). For the same set of stimuli as in a, the optimal criterion is shifted considerably to the right, and the overall proportion of correct responses drops from 0.84 to 0.75. <bold>(C)</bold>
As in <bold>(A)</bold>
, but showing performance in a two-stimulus yes/no task with S1 and one stimulus out of S2 with the weakest signal strength. <bold>(D)</bold>
As in <bold>(A)</bold>
, but showing performance in a two-stimulus yes/no task with S1 and one stimulus out of S2 with strongest signal strength. <bold>(E)</bold>
Psychometric functions for different task conditions: magenta, task as in <bold>(A)</bold>
, blue, task as in <bold>(B)</bold>
, green: psychometric curve resulting from a sequence of separate yes/no experiments where stimuli are presented pairwise and in blocks (i.e., S2 vs. S1–S1, S2 vs. S1–S2, S2 vs. S1–S3 etc.), red: psychometric curve resulting from a sequence of 2-AFC experiments where stimuli are presented pairwise and in blocks.</p>
</caption>
<graphic xlink:href="fnins-05-00125-g005"></graphic>
</fig>
<p>Now consider a somewhat different situation: the stimuli are identical to those described above, but presentation of S1 is as likely as presentation of all stimuli in S2 taken together – thus <italic>p</italic>
(S1) = 0.5, <italic>p</italic>
(S2) = 0.5, and <italic>p</italic>
(S2<sub><italic>i</italic>
</sub>
) = 0.5/5 = 0.1 for stimulus <italic>i</italic>
, where i ∈{1,2,3,4,5}. The optimal decision criterion has shifted considerably, and overall accuracy has dropped by 10% (see Figure <xref ref-type="fig" rid="F5">5</xref>
B). The resulting psychometric function is shown in Figure <xref ref-type="fig" rid="F5">5</xref>
E (blue), illustrating a marked reduction in the proportion of “S2” responses across all stimuli (for an example study, see Gerdjikov et al., <xref ref-type="bibr" rid="B36">2010</xref>
).</p>
<p>Imagine yet another situation: the observer is confronted with only two stimuli per session, S1 and one of the stimuli in category S2, in a series of YN experiments. This case is illustrated for two hardly distinguishable stimuli (Figure <xref ref-type="fig" rid="F5">5</xref>
C) and two easily distinguishable stimuli (Figure <xref ref-type="fig" rid="F5">5</xref>
D). For each of five possible pairs, percentage of correct responses can be calculated and used to construct a psychometric curve (Figure <xref ref-type="fig" rid="F5">5</xref>
E, green). Of course, one could also conduct five consecutive 2-AFC or 2-IFC tasks, yielding somewhat higher performance (Figure <xref ref-type="fig" rid="F5">5</xref>
E, red). As outlined in the previous section, 2-AFC/2-IFC performance (red) is consistently higher than YN performance (green) for ideal observers. This exercise illustrates an important point: psychophysical performance, measured in proportion correct responses, can be different under different tasks or even within the same task when identical stimuli occur with different probabilities. Notably, performance across tasks looks identical when transformed into the same unit of sensitivity, such as <inline-formula><mml:math id="M9"><mml:mrow><mml:msubsup><mml:mrow><mml:mi>d</mml:mi>
</mml:mrow>
<mml:mrow><mml:mstyle class="text"><mml:mtext>YN</mml:mtext>
</mml:mstyle>
</mml:mrow>
<mml:mrow><mml:mi>′</mml:mi>
</mml:mrow>
</mml:msubsup>
<mml:mo class="MathClass-punc">.</mml:mo>
</mml:mrow>
</mml:math>
</inline-formula>
</p>
</sec>
<sec><title>The minimally informed observer</title>
<p>We can use the previous example to make another point. Regarding the NP comparison, it is crucial that the performance of the neurons is considered under the same constraints as the subject. In NP comparisons, the term “ideal observer” is often used very loosely to describe the optimal performance that an observer could achieve in the task given the neural recordings and some assumptions about the neural code. There is, however, also the question of how much of the task and the stimuli is known to the observer. In order to distinguish an observer that has all the information available that is also available to the experimenter (and might hence be called ideal) from the situation that the subject is in, Boneau and Cole (<xref ref-type="bibr" rid="B11">1967</xref>
) coined the term “minimally informed observer” for a model that only uses the information that is available to the subject and nothing more.</p>
<p>Assume the subject is confronted with the situation depicted in Figure <xref ref-type="fig" rid="F5">5</xref>
B – an YN task in which the S1 stimulus presentation probability is the same as that of all S2-stimuli together. In parallel, unit recordings from sensory neurons were obtained, and the experimenter wishes to relate the subject’s performance to that of single neurons. The experimenter could, for example, compute ROC curves from the neuronal data for each pair of S1–S2 stimuli, and integrate the area under the ROC. The area under the ROC curve will correspond to the performance in a 2-AFC task if the difference model of SDT is correct and hence requires a correction of √2 to be comparable to an YN task. In Figure <xref ref-type="fig" rid="F5">5</xref>
E, this amounts to a transition from the red to the green curve. Still, the neuron would be unfairly favored, since the analysis assumes a sequence of YN tasks with only two stimuli per block, while the observer was faced with six stimuli simultaneously. Contrary to the experimenter the observer does not know which stimulus is shown on each trial. Thus, the only possible strategy for the observer is to adopt a single decision criterion, as shown in Figure <xref ref-type="fig" rid="F5">5</xref>
B. Optimal performance would accordingly result in the blue psychometric function in Figure <xref ref-type="fig" rid="F5">5</xref>
E, and this is the correct analysis to apply to the neuronal data: to find a criterion which maximizes the percentage of correct responses when multiple stimuli can appear. Studies in which this procedure was applied include de Lafuente and Romo (<xref ref-type="bibr" rid="B22">2005</xref>
) and Palmer et al. (<xref ref-type="bibr" rid="B84">2007</xref>
).</p>
</sec>
<sec><title>Process models for psychophysical performance</title>
<p>Given the success of SDT in fitting psychophysical data, it is tempting to think of the calculations involved as actual cognitive processes. For the YN task, the sequence of steps can be conceptualized as follows: (1) encode the stimulus into the decision variable, (2) compare current value of the decision variable to the decision criterion retrieved from long-term memory, (3) decide on a response (Figure <xref ref-type="fig" rid="F3">3</xref>
; see also Tanner, <xref ref-type="bibr" rid="B120">1961</xref>
). A process model for the GNG task with one stimulus per trial would be identical to that for YN, the difference being that, in YN, the observer has two response options (aside from non-task behavior), while in GNG, the observer has only one. Gomez et al. (<xref ref-type="bibr" rid="B39">2007</xref>
) tested formal models of GNG and conclude that core processes of GNG and YN may be identical under some circumstances.</p>
<p>Two-interval forced choice is more complicated because there exist more than one process model for appropriate (but also suboptimal) behavior. (a) The observer could ignore the stimulus in the first interval altogether and treat this task as an YN task, basing his decisions only on sensory evidence gathered in the second interval; (b) he could do the converse and base his decisions only on the first interval. In these two cases, we would expect that he performs just the same way with two stimuli as in the yes/no task. Another strategy (c) that will give the same performance with regard to percent correct would be to perform two times YN in succession. If the stimulus is detected in neither interval, or if it is falsely detected in both, a random response is produced. Otherwise the interval in which a stimulus was detected is chosen. Yet, there is a fourth, the optimal strategy, (d) that was already discussed above (illustrated in Figure <xref ref-type="fig" rid="F4">4</xref>
).</p>
<p>The important thing to note here is that, for a given psychophysical task, there may be more than one decision strategy to follow. It is often a convenient assumption that subjects follow the optimal strategy, but we must not forget that in most studies that conduct NP comparisons it is only an assumption. Consequently, both the processing required to yield a decision variable and the resulting performance may differ from subject to subject. Even if the sensory front end as an input to the system is fixed, subjects may use the available information in various, potentially suboptimal, ways. The 2-IFC task can however be adapted to force the animal to pay attention to both stimuli; see Romo and Salinas (<xref ref-type="bibr" rid="B97">2003</xref>
).</p>
<p>A similar caveat as for 2-IFC applies to the use of the yes/no task with a reference stimulus (YNR, see Box <xref ref-type="boxed-text" rid="BX1">1</xref>
), as for example used in Mountcastle et al. (<xref ref-type="bibr" rid="B73">1990</xref>
); Purushothaman and Bradley (<xref ref-type="bibr" rid="B90">2005</xref>
), Qin et al. (<xref ref-type="bibr" rid="B91">2009</xref>
), and Bizley et al., <xref ref-type="bibr" rid="B8">2010</xref>
; also see Lee et al., <xref ref-type="bibr" rid="B64">2007</xref>
; Hautus et al., <xref ref-type="bibr" rid="B46">2009</xref>
). An analysis of the YNR task is depicted in Figure <xref ref-type="fig" rid="F6">6</xref>
. Here, two stimuli per trial are presented. However, unlike 2-AFC/2-IFC, the first stimulus (reference, R) is identical for each trial, and the subject has to decide whether the second stimulus is more or less intense than R on some stimulus dimension. Again, the task is ambiguous as to its decision strategy. One strategy (the optimal one) is to ignore R completely and concentrate only on the second stimulus for decision-making. That way, YNR reduces to YN (Figure <xref ref-type="fig" rid="F6">6</xref>
A). This assumes, of course, that all stimuli are known exactly to the subject. R is, however, only introduced because the experimenter thinks that this is not the case. One suboptimal strategy that seems likely is hence to (1) encode R, (2) encode the second stimulus, (3) take their difference, and (4) decide according to the sign of the difference; if positive, the second stimulus is deemed more intense (Figure <xref ref-type="fig" rid="F6">6</xref>
B). This strategy is identical to the fourth strategy discussed in the context of the 2-IFC task; but this time, it yields suboptimal performance, decreasing 98% correct performance to 92% in the example. Furthermore, because of the ambiguity in task execution, it is unknown which neurometric analysis is most appropriate for this case.</p>
<fig id="F6" position="float"><label>Figure 6</label>
<caption><p><bold>Signal detection theoretical process models of performance in the yes/no task with reference stimulus</bold>
. <bold>(A)</bold>
Stimulus distributions along the decision variable under the optimal strategy. The reference stimulus sample is ignored on every trial, and thus the task reduces to the familiar yes/no task. <bold>(B)</bold>
Stimulus distributions along the decision variable under the suboptimal strategy, when subjects decide on the basis of the difference of the first and the second sample.</p>
</caption>
<graphic xlink:href="fnins-05-00125-g006"></graphic>
</fig>
<p>One study actually demonstrated that, in YNR, animals ignore the reference stimulus and thereby follow the optimal strategy. Hernandez et al. (<xref ref-type="bibr" rid="B48">1997</xref>
) trained monkeys to discriminate between two vibrotactile stimuli of different frequency. Monkeys were presented with a base stimulus first and a comparison stimulus second, and they had to judge whether the frequency of the comparison stimulus was higher than that of the base stimulus. Importantly, when the reference stimulus was omitted in control experiments, psychophysical performance did not change, suggesting that the reference stimulus has indeed been ignored by the animals. Also, when conditions were changed such that both base and comparison frequency varied randomly from trial to trial, performance dropped to chance levels, indicating that the animals did not perform the subtraction strategy as delineated above (Figure <xref ref-type="fig" rid="F6">6</xref>
B).</p>
<p>While process models inspired by SDT make clear predictions for comparing performance across different psychophysical tasks, data supporting these models as description of an observer’s decision strategy is sparse and conflicting. For example, Yeshurun et al. (<xref ref-type="bibr" rid="B137">2008</xref>
) reexamined several claims about the 2-IFC method. They found, contrary to widespread belief, that the 2-IFC task is not unbiased: observers consistently prefer one of the two intervals, and this preference could not be explained by attentional state, complexity of the stimulus display, interstimulus interval (ISI), or experience of the observers. That 2-IFC is usually not unbiased was also remarked on by Klein (<xref ref-type="bibr" rid="B60">2001</xref>
) and the topic was recently revisited by Garcia-Perez and Alcala-Quintana (<xref ref-type="bibr" rid="B34">2011</xref>
) in a reanalysis of a large number of datasets. Moreover, sensitivity during the two intervals may differ: Yeshurun et al. (<xref ref-type="bibr" rid="B137">2008</xref>
) provide some experimental evidence that <italic>d</italic>
′ in the first interval is larger than <italic>d</italic>
′ in the second interval. Similar observations have been reported and commented on by other authors (Nachmias, <xref ref-type="bibr" rid="B74">2006</xref>
; Ulrich and Vorberg, <xref ref-type="bibr" rid="B128">2009</xref>
; Ulrich, <xref ref-type="bibr" rid="B127">2010</xref>
). This asymmetry could be due to memory limitations, i.e., only a portion of the information from the first interval is retained, or due to perceptual interactions between the two presentation intervals. Importantly, Yeshurun et al. (<xref ref-type="bibr" rid="B137">2008</xref>
) found no evidence that <italic>d</italic>
′ in 2-IFC is <inline-formula><mml:math id="M10"><mml:mrow><mml:msubsup><mml:mrow><mml:mi>d</mml:mi>
</mml:mrow>
<mml:mrow><mml:mstyle class="text"><mml:mtext>YN</mml:mtext>
</mml:mstyle>
</mml:mrow>
<mml:mrow><mml:mi>′</mml:mi>
</mml:mrow>
</mml:msubsup>
</mml:mrow>
</mml:math>
</inline-formula>
<sup>*</sup>
√2, as postulated by SDT. Thus, the standard SDT-difference model of 2-IFC performance was rejected, and the authors conclude that “we do not currently know how to model what observers actually do in 2-IFC tasks and that we have no reason to think that models appropriate to one choice of stimuli can be generalized to others.” In a similar vein, Jäkel and Wichmann (<xref ref-type="bibr" rid="B54">2006</xref>
) compared 2-IFC with spatial 2-AFC and spatial four-alternative forced-choice (4-AFC) in a contrast detection task and found that, surprisingly, 2-IFC with foveal stimulation produced the highest thresholds and 4-AFC with more peripheral stimulation the lowest thresholds in naïve observers, but not in a highly experienced one. In a discrimination task with similar stimuli, 4-AFC did produce higher thresholds than 2-IFC, as expected. Although their data do not allow a clear interpretation of how the psychometric functions from the different tasks relate to each other, the authors speculate that extra-sensory factors, like sensory memory and spatial attention, have different effects in different tasks. It is noteworthy that these extra-sensory effects are ignored in SDT.</p>
<p>On the neurometric side it makes sense to calculate sensitivity using the optimal procedure in order to get an upper bound on the performance that an ideal observer could achieve based on the neural data. We usually also assume that the whole observer behaves optimally when calculating psychometric sensitivity. We have to be aware, however, that the actual sensitivity of the observer may be higher than observed, since he may be using the information that is available to him in a suboptimal way. Ideally, obtained psychometric functions should index “true sensitivity” – i.e., measure discrimination performance of a sensory system and be unaffected by choice of psychophysical method, variations in motivation, response measure, or response topography. The simultaneous measurement of neuronal and behavioral responses is considered the gold standard for conducting the NP comparison, because neuronal responses are not altered by anesthesia, the animal is actively engaged in the task, and stimulus variability across trials affects neurons and observer alike (Parker and Newsome, <xref ref-type="bibr" rid="B85">1998</xref>
). That way, important confounds inherent in comparing neurometric and psychometric data from different animals, such as plasticity of sensory representations during learning (Polley et al., <xref ref-type="bibr" rid="B86">2004</xref>
) or task-dependent changes in interneuronal correlations (Cohen and Newsome, <xref ref-type="bibr" rid="B19">2008</xref>
) are avoided. However, as outlined above, simultaneous acquisition of neurometric and psychometric data is not sufficient for conducting valid NP comparisons, because task-specific (and -unspecific, see below) factors may affect psychophysical performance without affecting neurometric performance. As a consequence, psychophysical performance will frequently fall short of true sensitivity.</p>
</sec>
<sec><title>Additional factors affecting measured discriminability</title>
<p>Psychometric discrimination and detection performance for identical stimuli have been shown to be affected not only by type of task (see preceding section), but by a variety of other factors as well. SDT explicitly acknowledges the role of prior presentation probability and reinforcement history of the stimuli, but there exists a wide range of factors which, we believe, have been largely ignored in previous work. In the following paragraphs, we will review some non-sensory factors that are known to affect psychophysical performance. A short list of important factors in conducting NP comparisons is provided in Table <xref ref-type="table" rid="T2">2</xref>
.</p>
<table-wrap id="T2" position="float"><label>Table 2</label>
<caption><p><bold>Overview over the most frequent factors potentially affecting the NP comparison</bold>
.</p>
</caption>
<table frame="hsides" rules="groups"><tbody><tr><td valign="top" align="left" rowspan="1" colspan="1">Temporal uncertainty (stimulus onset and offset not made explicit in detection task)</td>
</tr>
<tr><td valign="top" align="left" rowspan="1" colspan="1">Stimulus uncertainty (presenting more than two stimuli per block of trials, or presenting novel stimuli)</td>
</tr>
<tr><td valign="top" align="left" rowspan="1" colspan="1">Stimuli for neurometric and psychometric data collection differ appreciably</td>
</tr>
<tr><td valign="top" align="left" rowspan="1" colspan="1">Neurometric data gathered with different animals, under anesthesia or <italic>in vitro</italic>
</td>
</tr>
<tr><td valign="top" align="left" rowspan="1" colspan="1">Ambiguous task structure (e.g., yes/no with reminder)</td>
</tr>
<tr><td valign="top" align="left" rowspan="1" colspan="1">Subject not trained to asymptotic performance</td>
</tr>
<tr><td valign="top" align="left" rowspan="1" colspan="1">Subject lacks motivation</td>
</tr>
<tr><td valign="top" align="left" rowspan="1" colspan="1">Subject is inattentive</td>
</tr>
<tr><td valign="top" align="left" rowspan="1" colspan="1">Response bias</td>
</tr>
</tbody>
</table>
</table-wrap>
<sec><title>Learning, motivation, and fatigue</title>
<p>One would expect psychometric functions to change based on learning and this is a good reason to work with highly trained observers and only analyze the responses after their performance does not improve anymore (Fine and Jacobs, <xref ref-type="bibr" rid="B30">2002</xref>
). This is of course the case for most animal experiments, especially those involving monkeys, even though some studies employing rats or mice sometimes stop training when an arbitrary performance criterion of, e.g., 80–85% has been achieved. Nevertheless, even within a session, a highly trained animal may show systematic deviations from stationarity. In order to achieve a high level of motivation, animals in psychophysical studies are usually food- or water deprived. Nienborg and Cumming (<xref ref-type="bibr" rid="B79">2009</xref>
) used a yes/no task to assess disparity discrimination. They found that the delivery of larger rewards led to increased performance as measured by the slope of the psychometric function.</p>
<p>Hunger and satiety are known to offset response curves in psychophysical GNG tasks. Boneau and Cole (<xref ref-type="bibr" rid="B11">1967</xref>
) separated response probabilities observed during the first half of an experimental session, when the subject was supposedly most hungry, from the second half of the session, when the animal was arguably less hungry; they observed a substantial decrease in overall response probability from the first to the second half of the session, which showed up at the level of the psychometric function as a shift of threshold. Similar effects are of course to be expected when the subject gets tired. In order to detect such non-stationarities, one possibility is to compute a rank-biserial correlation between trial number and responses (e.g., 1 for correct and 0 for incorrect; see Stüttgen and Schwarz, <xref ref-type="bibr" rid="B112">2008</xref>
). Ideally, the correlation should be 0. If the correlation assumes negative values, the number of correct responses is increasing over the duration of the session. As another means to detect such effects, Wichmann and Hill (<xref ref-type="bibr" rid="B134">2001a</xref>
,<xref ref-type="bibr" rid="B135">b</xref>
) describe a statistical test that uses the order of the blocks in a constant stimuli design to predict the residuals for the fit of the psychometric function. Fruend et al. (<xref ref-type="bibr" rid="B32">2011</xref>
) assess the severity of such violations on the estimation of psychometric functions and suggest a suitable correction for the resulting confidence intervals.</p>
</sec>
<sec><title>Attention</title>
<p>Animals are presumably inattentive to the task a significant portion of the time. In principle, this problem is unrelated to the psychophysical task employed, but it may be especially detrimental in GNG. Lapses of attention in GNG will tend to yield fewer responses overall and thereby increase the measured threshold. In GNG, the experimenter has no way to identify whether the absence of a response in a given trial is indeed based on assessment of the sensory evidence in a trial or due to non-sensory factors such as lapse of attention or decreased motivation. However, even in YN and FC, this may cause problems if the animal does not simply refrain from responding on such trials, but instead presses buttons or makes saccades at random. To complicate issues further, it could be that, beyond non-sensory influences on response bias, sensitivity itself could be affected by fluctuations of attention. For example, Treue and Martinez Trujillo (<xref ref-type="bibr" rid="B125">1999</xref>
) reported that tuning curves of neurons in MT are gain-controlled by attention. Assuming spike count as the relevant code, this could affect performance if neurons tuned to the stimulus increased their firing rate while the firing rate of “comparison neurons” not tuned for the stimulus, remained the same; in SDT terms, the mean of the signal distribution would move away from the mean of the noise distribution, yielding an increase in <italic>d</italic>
′. To control for fluctuations in attention within a session, experimenters can follow strategies as suggested in the previous section on motivation and fatigue.</p>
</sec>
<sec><title>Working memory</title>
<p>In GNG and YN tasks, working memory is not required in the sense that sensory information needs to be maintained over a short time span, e.g., a visual or auditory signal (this is not meant to imply that task execution is completely independent of working memory, as the animal needs to recall what task to perform, which lever or button to press under what circumstances etc.). In 2-IFC, SDT assumes perfect retention of the first stimulus, regardless of the ISI. If the sequence of the stimuli is seamless, no working memory is needed and discriminability depends on the temporal contrast of the two stimuli. In this case, the 2-IFC paradigm tests predominantly sensory coding. If, however, the stimuli are separated by a non-zero ISI, storing and retrieving stimulus properties in working memory plays a decisive role. Importantly, performance in 2-IFC is affected by the duration of the ISI. If the ISI is too long, performance decreases (Harris et al., <xref ref-type="bibr" rid="B45">2001</xref>
). It is a welcome recent development in neurophysiology that the mechanisms of sensory working memory are under investigation (Romo et al., <xref ref-type="bibr" rid="B96">1999</xref>
). The interplay between simple psychophysical paradigms and working memory is certainly a worthwhile field of theoretical and experimental development (Machens et al., <xref ref-type="bibr" rid="B67">2005</xref>
). In any case, it is likely that neurometrics in 2-IFC overestimate performance when sensory neuron responses during the first stimulus period are used, rather than the memory trace of the first stimulus as represented by working memory neurons.</p>
</sec>
<sec><title>Sequential effects</title>
<p>Boneau et al. (<xref ref-type="bibr" rid="B12">1965</xref>
) showed that, at the level of individual trials, non-rewarded stimuli are more likely to elicit a response when they immediately follow a rewarded trial (in a GNG task). In addition, Busse et al. (<xref ref-type="bibr" rid="B16">2011</xref>
) report that animals tend to switch sides after each trial, regardless of success or failure. Verplanck et al. (<xref ref-type="bibr" rid="B130">1952</xref>
) have shown that for human subjects trials in a detection experiment are not independent – contrary to the usual assumption, subsequent trials in a detection experiment were positively correlated. If these effects were just due to higher cognitive effects, like the gambler’s fallacy, then perhaps there would be hope that their effects could be minimized by instruction or training. However, there are indications that the sequential effects are a trace of the mechanisms that produce the observed behavior. For identification tasks (such as the YN task) it seems likely that the subject needs to store the ideal stimuli in long-term memory and then compares the stimulus on each trial to the stored representations to decide on a response. However, Stewart et al. (<xref ref-type="bibr" rid="B109">2005</xref>
) argue that in many cases long-term memory is not necessary and that a simple mechanism that only compares the current stimulus to the last trial can explain many aspects of the data. For detection tasks, Treisman and Williams (<xref ref-type="bibr" rid="B124">1984</xref>
) have argued that the sequential effects arise through an adaptive setting of the criterion based on previous trials. If this was the case then the fluctuations in the criterion should be taken into account when assessing a subject’s sensitivity, e.g., by separating trials according to stimuli presented in each preceding trial.</p>
</sec>
<sec><title>Stimulus set</title>
<p>The measured psychophysical discriminability of two given stimuli can depend on whether, which and how many other stimuli constitute a stimulus set in an experimental session (Stüttgen, unpublished data).</p>
<p>In many psychological experiments the stimulus range can influence the behavior that one wants to measure, often with unexpected results (Poulton, <xref ref-type="bibr" rid="B88">1975</xref>
). For example, Lages and Treisman (<xref ref-type="bibr" rid="B63">1998</xref>
) show that a task that suggests comparison of a stimulus to a reference stimulus from long-term memory is actually solved by the subject by taking into account the stimulus range without recourse to the reference stimulus at all (a possible explanation for this can be found in Treisman and Williams, <xref ref-type="bibr" rid="B124">1984</xref>
).</p>
<p>A related problem is that, in many neurophysiological studies, details of the stimuli (e.g., retinal position, motion direction, contrast etc.) are meticulously matched to the receptive field properties of the neuron currently under study, in order to maximize the chance that this neuron is actually involved in the psychophysical task. However, because this stimulus adaptation has to be done for each single unit recording (see Britten et al., <xref ref-type="bibr" rid="B15">1992</xref>
), it may have detrimental effects on the performance of the subject which is required to generalize the task across a large variety of stimuli, many of which it may never have seen before. For most sensory areas, it is commonly assumed that the neural response to a stimulus is thought to be largely unaffected by stimulus history, as long as some reasonable ISI is provided. Accordingly, neural representation of a given stimulus should remain unaltered by the number of stimuli in a stimulus set, while psychophysical performance is not. Therefore, experimenters should take care to meet the assumptions of SDT lest the subjects exhibit suboptimal performance.</p>
</sec>
<sec><title>Temporal and stimulus uncertainty</title>
<p>It is often neglected that ideal observer analysis of spike responses using SDT (construction of ROC curves) requires some assumptions that are frequently not met by experimental conditions. SDT analysis assumes that the observer knows everything about the signal, including starting time, duration, phase, frequency, amplitude, and location – a prerequisite sometimes referred to as “signal specified exactly.” If experimental subjects are uncertain as to any of these parameters, performance decreases (Shipley, <xref ref-type="bibr" rid="B105">1960</xref>
; Swets et al., <xref ref-type="bibr" rid="B119">1961</xref>
; Green and Weber, <xref ref-type="bibr" rid="B43">1980</xref>
; Green and Forrest, <xref ref-type="bibr" rid="B41">1989</xref>
).</p>
<p>Many neuroscience studies aiming at the NP comparison violate at least one of these assumptions; most often, multiple stimuli are used per experimental block (see stimulus range), or the timing of the stimulus is held uncertain (e.g., de Lafuente and Romo, <xref ref-type="bibr" rid="B22">2005</xref>
; Stüttgen et al., <xref ref-type="bibr" rid="B111">2006</xref>
). Hernandez et al. (<xref ref-type="bibr" rid="B48">1997</xref>
) compared monkeys’ performance for vibrotactile frequency discrimination in two different tasks: yes/no with reference stimulus and 2-IFC with variable stimulus pairs across trials. The monkey’s difference limina in the first set of experiments were lower by ∼30% (thus, sensitivity was higher). This effect is likely due to the added stimulus uncertainty, because performance in the second experiment would be expected to <italic>increase</italic>
according to SDT. Assuming that neural responses were not systematically affected by task type, the NP comparisons would yield different results for the two sets of experiments.</p>
</sec>
</sec>
</sec>
<sec><title>Which Task is Best Suited for the Neurometric–Psychometric Comparison?</title>
<p>Blackwell (<xref ref-type="bibr" rid="B9">1952</xref>
) systematically compared psychophysical methods for measuring visual thresholds in human subjects. He concluded that the 2-IFC method is superior to YN on several indices of quality, including reliability of threshold measurement (variability of repeated assessments of threshold), vulnerability of threshold measurement to non-sensory biasing factors (i.e., procedural factors such as background illumination, number, spacing, and order of stimuli, whether feedback was provided, and whether financial incentives for optimal performance was offered), and the absolute magnitude of the psychophysical threshold. Jäkel and Wichmann (<xref ref-type="bibr" rid="B54">2006</xref>
) reinvestigated this issue and confirmed Blackwell’s earlier results for a visual detection task – however, only for experienced observers. For naïve observers, in contrast, spatial 4-AFC was superior in terms of reliability, bias, sensory determinacy, and efficiency of measurement. For animal subjects, Mentzer (<xref ref-type="bibr" rid="B71">1966</xref>
) has conducted similar comparisons of YN, 2-AFC, and 4-AFC for light detection in pigeons, but could not find any performance differences. Frederick et al. (<xref ref-type="bibr" rid="B31">2011</xref>
) conducted a comparison of GNG and YN for odor discrimination and also found no evidence for major differences in resulting performance.</p>
<p>Most psychophysical studies employing unit recordings in primates have used the YN method, even though it is usually referred to by another name (e.g., Britten et al., <xref ref-type="bibr" rid="B15">1992</xref>
, <xref ref-type="bibr" rid="B14">1996</xref>
; Dodd et al., <xref ref-type="bibr" rid="B25">2001</xref>
; Uka and DeAngelis, <xref ref-type="bibr" rid="B126">2003</xref>
; Heuer and Britten, <xref ref-type="bibr" rid="B50">2004</xref>
; de Lafuente and Romo, <xref ref-type="bibr" rid="B22">2005</xref>
; Nienborg and Cumming, <xref ref-type="bibr" rid="B77">2006</xref>
, <xref ref-type="bibr" rid="B78">2007</xref>
, <xref ref-type="bibr" rid="B79">2009</xref>
); some have used GNG (Cook and Maunsell, <xref ref-type="bibr" rid="B21">2002</xref>
; Palmer et al., <xref ref-type="bibr" rid="B84">2007</xref>
); or some other method (YNR: Mountcastle et al., <xref ref-type="bibr" rid="B73">1990</xref>
; Purushothaman and Bradley, <xref ref-type="bibr" rid="B90">2005</xref>
; Qin et al., <xref ref-type="bibr" rid="B91">2009</xref>
; Bizley et al., <xref ref-type="bibr" rid="B8">2010</xref>
; same-different: Vogels and Orban, <xref ref-type="bibr" rid="B131">1990</xref>
). A series of studies by the Romo group has consistently employed 2-IFC (Romo et al., <xref ref-type="bibr" rid="B96">1999</xref>
; Hernandez et al., <xref ref-type="bibr" rid="B49">2000</xref>
; for review, see Romo and Salinas, <xref ref-type="bibr" rid="B97">2003</xref>
). To our knowledge, psychophysics with concomitant unit recordings in other species – most notably rats and mice – have so far almost exclusively relied on GNG (Stüttgen et al., <xref ref-type="bibr" rid="B111">2006</xref>
; Mehta et al., <xref ref-type="bibr" rid="B70">2007</xref>
; Stüttgen and Schwarz, <xref ref-type="bibr" rid="B112">2008</xref>
, <xref ref-type="bibr" rid="B113">2010</xref>
; Andermann et al., <xref ref-type="bibr" rid="B2">2010</xref>
; Gerdjikov et al., <xref ref-type="bibr" rid="B36">2010</xref>
; O’Connor et al., <xref ref-type="bibr" rid="B81">2010a</xref>
,<xref ref-type="bibr" rid="B82">b</xref>
) or YN (Krupa et al., <xref ref-type="bibr" rid="B62">2001</xref>
; Prigg et al., <xref ref-type="bibr" rid="B89">2002</xref>
; Feierstein et al., <xref ref-type="bibr" rid="B28">2006</xref>
; von Heimendahl et al., <xref ref-type="bibr" rid="B133">2007</xref>
; Kepecs et al., <xref ref-type="bibr" rid="B57">2008</xref>
; Frederick et al., <xref ref-type="bibr" rid="B31">2011</xref>
). However, these species can be trained on FC tasks as well (pigeons: spatial 2-AFC: Blough, <xref ref-type="bibr" rid="B10">1971</xref>
; 4-AFC: Mentzer, <xref ref-type="bibr" rid="B71">1966</xref>
; mice: 2-AFC, Jacobs et al., <xref ref-type="bibr" rid="B53">2009</xref>
; Busse et al., <xref ref-type="bibr" rid="B16">2011</xref>
; Haiss et al., submitted; rats: 2-AFC: Knutsen et al., <xref ref-type="bibr" rid="B61">2006</xref>
; Adibi and Arabzadeh, <xref ref-type="bibr" rid="B1">2011</xref>
). We know of no study with these species which employed the <italic>m</italic>
-IFC task; still, since rats, mice, and pigeons are known to learn delayed matching-to-sample problems (rats: Kesner et al., <xref ref-type="bibr" rid="B58">1996</xref>
; mice: Goto et al., <xref ref-type="bibr" rid="B40">2010</xref>
; pigeons: Lissek and Güntürkün, <xref ref-type="bibr" rid="B65">2004</xref>
), it should be possible to train them on <italic>m</italic>
-IFC as well. To sum up, while most studies have so far employed YN, other methods seem feasible. It is common understanding in the community of researchers (based on anecdotal evidence) that GNG is trained faster than YN (but see Frederick et al., <xref ref-type="bibr" rid="B31">2011</xref>
), which again may be trained faster than IFC. More effort is required to make all psychophysical tasks routinely available for future psychophysical research. Spatial <italic>m</italic>
-AFC has the disadvantage that, since several stimuli are presented simultaneously, it is difficult to control for repetitive shifts of attention during the course of a single trial, and to attribute modulations in unit activity to any one stimulus, as opposed to the entire stimulus display. <italic>m</italic>
-IFC avoids this problem because stimuli are presented successively. On the other hand, <italic>m</italic>
-IFC requires working memory for the stimulus during the ISI (unless the interval is zero). In addition, all FC variants (as well as YNR) leave room for different decision strategies (see above), which need to be properly assessed before conducting the NP comparison. GNG and YN methods have the advantage that no sequential or simultaneous stimulus presentation is required. Accordingly, no working memory for a sensory stimulus is necessary, which potentially simplifies the task. We believe that the YN method is particularly well suited for NP comparisons. Unlike GNG, lapses of attention, or impulsive responding do not directly contaminate the response measure, compared to FC and YNR, there are less degrees of freedom in terms of strategy to employ, although we regret to say that there are no good data to back up this claim, and these data are badly needed.</p>
</sec>
<sec><title>Conclusion</title>
<p>The comparison of neurometric and psychometric sensitivity is fraught with problems. We have argued in this review that, in stark contrast to estimation of neurometric sensitivity, problems with the estimation of psychometric sensitivity have been largely ignored in the literature on the physiology of perception. Nevertheless, on both sides significant progress will be needed to make NP measurements more precise. Here we list some recommendations for future work originating from the points raised in this review.</p>
<p>On the neurometric side, we see the research program based on recording single neurons while activating them with sensory stimuli coming to an end. This approach has been invaluable to demonstrate that the neurometric sensitivity of single cells most often reaches close to (but hardly surpasses) that of the observer, thus fostering a central tenet of theories of sparse coding, as predicted by Barlow and Mountcastle. However, beyond showing sparse coding to be feasible in principle, this approach helps little in elucidating the role of the large neural populations activated even by near-threshold stimulation. The goal of today must be to characterize the neuronal code of the population of neurons carrying precisely the information leading to behavior. The need to define and access informational bottlenecks renders this a tough task. Retinal ganglion cells have been spotted to be one such bottleneck and should be exploited further. The creation of bottlenecks by juxtacellular stimulation and soon by optogenetic means will allow carrying this research program further both in rodents and in monkeys. In passing, we point out that bottlenecks can be found and/or created very easily in invertebrate model systems which sometimes employ just single or a few neurons to carry lifesaving, and thus, evolutionary relevant information. An instructive example has been provided by Roeder in his studies of noctuid moths. These insects use auditory information from just two neurons per ear to decide on different tactics to escape foraging bats (Roeder, <xref ref-type="bibr" rid="B94">1966</xref>
). Insects exhibit complex types of behavior, such as working memory and decision making (Menzel and Giurfa, <xref ref-type="bibr" rid="B72">2001</xref>
; Pompilio et al., <xref ref-type="bibr" rid="B87">2006</xref>
). Also, they offer exquisite experimental flexibility in terms of genetic manipulation and optical imaging of neuronal function (Briggman et al., <xref ref-type="bibr" rid="B13">2005</xref>
; Haehnel et al., <xref ref-type="bibr" rid="B44">2009</xref>
). Accordingly, invertebrates may serve as valuable model systems to investigate the physiology of perception, and to offer useful insights for the studies of mechanisms of perceptual decision making in mammals.</p>
<p>On the psychometric side, the importance of task structure and other non-sensory factors relevant for psychophysical performance must be acknowledged. More effort is needed to validate the measurements of psychometric sensitivity by deliberate variation of task structure while maintaining a constant stimulus set. For instance, results from YNR or FC studies that allow ambiguous interpretations in terms of underlying cognitive processes can be validated by applying YN tasks. Formal models of the cognitive processes underlying different tasks need to be refined and pitted against each other both with purely behavioral tests (Gomez et al., <xref ref-type="bibr" rid="B39">2007</xref>
; Jang et al., <xref ref-type="bibr" rid="B55">2009</xref>
; Wolfe and Van Wert, <xref ref-type="bibr" rid="B136">2010</xref>
; Frederick et al., <xref ref-type="bibr" rid="B31">2011</xref>
; Stüttgen et al., <xref ref-type="bibr" rid="B114">2011</xref>
) and with neural recordings (Smith and Ratcliff, <xref ref-type="bibr" rid="B108">2004</xref>
; Gold and Shadlen, <xref ref-type="bibr" rid="B38">2007</xref>
; Churchland et al., <xref ref-type="bibr" rid="B18">2008</xref>
; Kepecs et al., <xref ref-type="bibr" rid="B57">2008</xref>
). It is unclear what kind of comparison process underlies perceptual decisions, i.e., what is actually compared (Stüttgen et al., <xref ref-type="bibr" rid="B114">2011</xref>
). The effect of storing sample stimuli and/or decision criteria in long-term and working memory against which current sensory information can be compared demands clarification. As shown in Figure <xref ref-type="fig" rid="F5">5</xref>
, psychometric performance for identical stimulus discriminations can be wildly different dependent on presentation strategy. Thus, psychometric performance must be compared with presenting pairs of stimuli vs. a whole stimulus array, and algorithms to calculate optimal neurometric sensitivity must be adjusted to reflect the animals’ optimal strategy, given these circumstances. For further studies of neural coding in sensory system, we hold it vital to acknowledge that clean estimates of “true” psychophysical sensitivity cannot be obtained without appropriate models of perceptual decision-making. Such models need not only isolate sensitivity from response bias (Tanner and Swets, <xref ref-type="bibr" rid="B121">1954</xref>
; McCarthy and Davison, <xref ref-type="bibr" rid="B69">1981</xref>
; Busse et al., <xref ref-type="bibr" rid="B16">2011</xref>
) but from other factors affecting observed performance as well, be they inherent to the psychophysical task or not.</p>
</sec>
<sec><title>Conflict of Interest Statement</title>
<p>The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.</p>
</sec>
</body>
<back><ref-list><title>References</title>
<ref id="B1"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Adibi</surname>
<given-names>M.</given-names>
</name>
<name><surname>Arabzadeh</surname>
<given-names>E.</given-names>
</name>
</person-group>
(<year>2011</year>
). <article-title>A comparison of neuronal and behavioral detection and discrimination performances in rat whisker system</article-title>
. <source>J. Neurophysiol.</source>
<volume>105</volume>
, <fpage>356</fpage>
–<lpage>365</lpage>
<pub-id pub-id-type="doi">10.1152/jn.00794.2010</pub-id>
<pub-id pub-id-type="pmid">21068262</pub-id>
</mixed-citation>
</ref>
<ref id="B2"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Andermann</surname>
<given-names>M. L.</given-names>
</name>
<name><surname>Kerlin</surname>
<given-names>A. M.</given-names>
</name>
<name><surname>Reid</surname>
<given-names>R. C.</given-names>
</name>
</person-group>
(<year>2010</year>
). <article-title>Chronic cellular imaging of mouse visual cortex during operant behavior and passive viewing</article-title>
. <source>Front. Cell. Neurosci.</source>
<volume>4</volume>
:<fpage>3</fpage>
<pub-id pub-id-type="doi">10.3389/fncel.2010.00003</pub-id>
<pub-id pub-id-type="pmid">20407583</pub-id>
</mixed-citation>
</ref>
<ref id="B3"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Arabzadeh</surname>
<given-names>E.</given-names>
</name>
<name><surname>Panzeri</surname>
<given-names>S.</given-names>
</name>
<name><surname>Diamond</surname>
<given-names>M. E.</given-names>
</name>
</person-group>
(<year>2006</year>
). <article-title>Deciphering the spike train of a sensory neuron: counts and temporal patterns in the rat whisker pathway</article-title>
. <source>J. Neurosci.</source>
<volume>26</volume>
, <fpage>9216</fpage>
–<lpage>9226</lpage>
<pub-id pub-id-type="doi">10.1523/JNEUROSCI.1491-06.2006</pub-id>
<pub-id pub-id-type="pmid">16957078</pub-id>
</mixed-citation>
</ref>
<ref id="B4"><mixed-citation publication-type="book"><person-group person-group-type="author"><name><surname>Baird</surname>
<given-names>J. C.</given-names>
</name>
<name><surname>Noma</surname>
<given-names>E. J.</given-names>
</name>
</person-group>
(<year>1978</year>
). <source>Fundamentals of Scaling and Psychophysics</source>
. <publisher-loc>New York</publisher-loc>
: <publisher-name>Wiley</publisher-name>
</mixed-citation>
</ref>
<ref id="B5"><mixed-citation publication-type="book"><person-group person-group-type="author"><name><surname>Barlow</surname>
<given-names>H. B.</given-names>
</name>
</person-group>
(<year>1961</year>
). <article-title>“Possible principles underlying the transformations of sensory messages”</article-title>
, in <source>Sensory Communication</source>
, ed. <person-group person-group-type="editor"><name><surname>Rosenblith</surname>
<given-names>W.</given-names>
</name>
</person-group>
(<publisher-loc>Cambridge</publisher-loc>
: <publisher-name>MIT Press</publisher-name>
), <fpage>217</fpage>
–<lpage>234</lpage>
</mixed-citation>
</ref>
<ref id="B6"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Barlow</surname>
<given-names>H. B.</given-names>
</name>
</person-group>
(<year>1972</year>
). <article-title>Single units and sensation: a neuron doctrine for perceptual psychology?</article-title>
<source>Perception</source>
<volume>1</volume>
, <fpage>371</fpage>
–<lpage>394</lpage>
<pub-id pub-id-type="doi">10.1068/p010371</pub-id>
<pub-id pub-id-type="pmid">4377168</pub-id>
</mixed-citation>
</ref>
<ref id="B7"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Bialek</surname>
<given-names>W.</given-names>
</name>
<name><surname>Rieke</surname>
<given-names>F.</given-names>
</name>
<name><surname>de Ruyter van Steveninck</surname>
<given-names>R. R.</given-names>
</name>
<name><surname>Warland</surname>
<given-names>D.</given-names>
</name>
</person-group>
(<year>1991</year>
). <article-title>Reading a neural code</article-title>
. <source>Science</source>
<volume>252</volume>
, <fpage>1854</fpage>
–<lpage>1857</lpage>
<pub-id pub-id-type="doi">10.1126/science.2063199</pub-id>
<pub-id pub-id-type="pmid">2063199</pub-id>
</mixed-citation>
</ref>
<ref id="B8"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Bizley</surname>
<given-names>J. K.</given-names>
</name>
<name><surname>Walker</surname>
<given-names>K. M. M.</given-names>
</name>
<name><surname>King</surname>
<given-names>A. J.</given-names>
</name>
<name><surname>Schnupp</surname>
<given-names>J. W. H.</given-names>
</name>
</person-group>
(<year>2010</year>
). <article-title>Neural ensemble codes for stimulus periodicity in auditory cortex</article-title>
. <source>J. Neurosci.</source>
<volume>30</volume>
, <fpage>5078</fpage>
–<lpage>5091</lpage>
<pub-id pub-id-type="doi">10.1523/JNEUROSCI.5475-09.2010</pub-id>
<pub-id pub-id-type="pmid">20371828</pub-id>
</mixed-citation>
</ref>
<ref id="B9"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Blackwell</surname>
<given-names>H. R.</given-names>
</name>
</person-group>
(<year>1952</year>
). <article-title>Studies of psychophysical methods for measuring visual thresholds</article-title>
. <source>J. Opt. Soc. Am.</source>
<volume>42</volume>
, <fpage>606</fpage>
–<lpage>616</lpage>
<pub-id pub-id-type="doi">10.1364/JOSA.42.000606</pub-id>
<pub-id pub-id-type="pmid">13000567</pub-id>
</mixed-citation>
</ref>
<ref id="B10"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Blough</surname>
<given-names>P. M.</given-names>
</name>
</person-group>
(<year>1971</year>
). <article-title>Visual acuity of pigeon for distant targets</article-title>
. <source>J. Exp. Anal. Behav.</source>
<volume>15</volume>
, <fpage>57</fpage>
–<lpage>67</lpage>
<pub-id pub-id-type="doi">10.1901/jeab.1971.15-57</pub-id>
<pub-id pub-id-type="pmid">5547284</pub-id>
</mixed-citation>
</ref>
<ref id="B11"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Boneau</surname>
<given-names>C. A.</given-names>
</name>
<name><surname>Cole</surname>
<given-names>J. L.</given-names>
</name>
</person-group>
(<year>1967</year>
). <article-title>Decision theory, the pigeon, and the psychophysical function</article-title>
. <source>Psychol. Rev.</source>
<volume>74</volume>
, <fpage>123</fpage>
–<lpage>135</lpage>
<pub-id pub-id-type="doi">10.1037/h0024287</pub-id>
<pub-id pub-id-type="pmid">6040259</pub-id>
</mixed-citation>
</ref>
<ref id="B12"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Boneau</surname>
<given-names>C. A.</given-names>
</name>
<name><surname>Holland</surname>
<given-names>M. K.</given-names>
</name>
<name><surname>Baker</surname>
<given-names>W. M.</given-names>
</name>
</person-group>
(<year>1965</year>
). <article-title>Color-discrimination performance of pigeons – effects of reward</article-title>
. <source>Science</source>
<volume>149</volume>
, <fpage>1113</fpage>
–<lpage>1114</lpage>
<pub-id pub-id-type="doi">10.1126/science.149.3688.1113</pub-id>
<pub-id pub-id-type="pmid">5826528</pub-id>
</mixed-citation>
</ref>
<ref id="B13"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Briggman</surname>
<given-names>K. L.</given-names>
</name>
<name><surname>Abarbanel</surname>
<given-names>H. D.</given-names>
</name>
<name><surname>Kristan</surname>
<given-names>W. B.</given-names>
<suffix>Jr.</suffix>
</name>
</person-group>
(<year>2005</year>
). <article-title>Optical imaging of neuronal populations during decision-making</article-title>
. <source>Science</source>
<volume>307</volume>
, <fpage>896</fpage>
–<lpage>901</lpage>
<pub-id pub-id-type="doi">10.1126/science.1103736</pub-id>
<pub-id pub-id-type="pmid">15705844</pub-id>
</mixed-citation>
</ref>
<ref id="B14"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Britten</surname>
<given-names>K. H.</given-names>
</name>
<name><surname>Newsome</surname>
<given-names>W. T.</given-names>
</name>
<name><surname>Shadlen</surname>
<given-names>M. N.</given-names>
</name>
<name><surname>Celebrini</surname>
<given-names>S.</given-names>
</name>
<name><surname>Movshon</surname>
<given-names>J. A.</given-names>
</name>
</person-group>
(<year>1996</year>
). <article-title>A relationship between behavioral choice and the visual responses of neurons in macaque MT</article-title>
. <source>Vis. Neurosci.</source>
<volume>13</volume>
, <fpage>87</fpage>
–<lpage>100</lpage>
<pub-id pub-id-type="doi">10.1017/S095252380000715X</pub-id>
<pub-id pub-id-type="pmid">8730992</pub-id>
</mixed-citation>
</ref>
<ref id="B15"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Britten</surname>
<given-names>K. H.</given-names>
</name>
<name><surname>Shadlen</surname>
<given-names>M. N.</given-names>
</name>
<name><surname>Newsome</surname>
<given-names>W. T.</given-names>
</name>
<name><surname>Movshon</surname>
<given-names>J. A.</given-names>
</name>
</person-group>
(<year>1992</year>
). <article-title>The analysis of visual motion: a comparison of neuronal and psychophysical performance</article-title>
. <source>J. Neurosci.</source>
<volume>12</volume>
, <fpage>4745</fpage>
–<lpage>4765</lpage>
<pub-id pub-id-type="pmid">1464765</pub-id>
</mixed-citation>
</ref>
<ref id="B16"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Busse</surname>
<given-names>L.</given-names>
</name>
<name><surname>Ayaz</surname>
<given-names>A.</given-names>
</name>
<name><surname>Dhruv</surname>
<given-names>N. T.</given-names>
</name>
<name><surname>Katzner</surname>
<given-names>S.</given-names>
</name>
<name><surname>Saleem</surname>
<given-names>A. B.</given-names>
</name>
<name><surname>Scholvinck</surname>
<given-names>M. L.</given-names>
</name>
<name><surname>Zaharia</surname>
<given-names>A. D.</given-names>
</name>
<name><surname>Carandini</surname>
<given-names>M.</given-names>
</name>
</person-group>
(<year>2011</year>
). <article-title>The detection of visual contrast in the behaving mouse</article-title>
. <source>J. Neurosci.</source>
<volume>31</volume>
, <fpage>11351</fpage>
–<lpage>11361</lpage>
<pub-id pub-id-type="doi">10.1523/JNEUROSCI.6689-10.2011</pub-id>
<pub-id pub-id-type="pmid">21813694</pub-id>
</mixed-citation>
</ref>
<ref id="B17"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Celebrini</surname>
<given-names>S.</given-names>
</name>
<name><surname>Newsome</surname>
<given-names>W. T.</given-names>
</name>
</person-group>
(<year>1994</year>
). <article-title>Neuronal and psychophysical sensitivity to motion signals in extrastriate area MST of the macaque monkey</article-title>
. <source>J. Neurosci.</source>
<volume>14</volume>
, <fpage>4109</fpage>
–<lpage>4124</lpage>
<pub-id pub-id-type="pmid">8027765</pub-id>
</mixed-citation>
</ref>
<ref id="B18"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Churchland</surname>
<given-names>A. K.</given-names>
</name>
<name><surname>Kiani</surname>
<given-names>R.</given-names>
</name>
<name><surname>Shadlen</surname>
<given-names>M. N.</given-names>
</name>
</person-group>
(<year>2008</year>
). <article-title>Decision-making with multiple alternatives</article-title>
. <source>Nat. Neurosci.</source>
<volume>11</volume>
, <fpage>693</fpage>
–<lpage>702</lpage>
<pub-id pub-id-type="doi">10.1038/nn.2123</pub-id>
<pub-id pub-id-type="pmid">18488024</pub-id>
</mixed-citation>
</ref>
<ref id="B19"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Cohen</surname>
<given-names>M. R.</given-names>
</name>
<name><surname>Newsome</surname>
<given-names>W. T.</given-names>
</name>
</person-group>
(<year>2008</year>
). <article-title>Context-dependent changes in functional circuitry in visual area MT</article-title>
. <source>Neuron</source>
<volume>60</volume>
, <fpage>162</fpage>
–<lpage>173</lpage>
<pub-id pub-id-type="doi">10.1016/j.neuron.2008.08.007</pub-id>
<pub-id pub-id-type="pmid">18940596</pub-id>
</mixed-citation>
</ref>
<ref id="B20"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Cohen</surname>
<given-names>M. R.</given-names>
</name>
<name><surname>Newsome</surname>
<given-names>W. T.</given-names>
</name>
</person-group>
(<year>2009</year>
). <article-title>Estimates of the contribution of single neurons to perception depend on timescale and noise correlation</article-title>
. <source>J. Neurosci.</source>
<volume>29</volume>
, <fpage>6635</fpage>
–<lpage>6648</lpage>
<pub-id pub-id-type="doi">10.1523/JNEUROSCI.3669-09.2009</pub-id>
<pub-id pub-id-type="pmid">19458234</pub-id>
</mixed-citation>
</ref>
<ref id="B21"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Cook</surname>
<given-names>E. P.</given-names>
</name>
<name><surname>Maunsell</surname>
<given-names>J. H.</given-names>
</name>
</person-group>
(<year>2002</year>
). <article-title>Dynamics of neuronal responses in macaque MT and VIP during motion detection</article-title>
. <source>Nat. Neurosci.</source>
<volume>5</volume>
, <fpage>985</fpage>
–<lpage>994</lpage>
<pub-id pub-id-type="doi">10.1038/nn924</pub-id>
<pub-id pub-id-type="pmid">12244324</pub-id>
</mixed-citation>
</ref>
<ref id="B22"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>de Lafuente</surname>
<given-names>V.</given-names>
</name>
<name><surname>Romo</surname>
<given-names>R.</given-names>
</name>
</person-group>
(<year>2005</year>
). <article-title>Neuronal correlates of subjective sensory experience</article-title>
. <source>Nat. Neurosci.</source>
<volume>8</volume>
, <fpage>1698</fpage>
–<lpage>1703</lpage>
<pub-id pub-id-type="doi">10.1038/nn1587</pub-id>
<pub-id pub-id-type="pmid">16286929</pub-id>
</mixed-citation>
</ref>
<ref id="B23"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>de Ruyter van Steveninck</surname>
<given-names>R. R.</given-names>
</name>
<name><surname>Lewen</surname>
<given-names>G. D.</given-names>
</name>
<name><surname>Strong</surname>
<given-names>S. P.</given-names>
</name>
<name><surname>Koberle</surname>
<given-names>R.</given-names>
</name>
<name><surname>Bialek</surname>
<given-names>W.</given-names>
</name>
</person-group>
(<year>1997</year>
). <article-title>Reproducibility and variability in neural spike trains</article-title>
. <source>Science</source>
<volume>275</volume>
, <fpage>1805</fpage>
–<lpage>1808</lpage>
<pub-id pub-id-type="doi">10.1126/science.275.5307.1805</pub-id>
<pub-id pub-id-type="pmid">9065407</pub-id>
</mixed-citation>
</ref>
<ref id="B24"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Diester</surname>
<given-names>I.</given-names>
</name>
<name><surname>Kaufman</surname>
<given-names>M. T.</given-names>
</name>
<name><surname>Mogri</surname>
<given-names>M.</given-names>
</name>
<name><surname>Pashaie</surname>
<given-names>R.</given-names>
</name>
<name><surname>Goo</surname>
<given-names>W.</given-names>
</name>
<name><surname>Yizhar</surname>
<given-names>O.</given-names>
</name>
<name><surname>Ramakrishnan</surname>
<given-names>C.</given-names>
</name>
<name><surname>Deisseroth</surname>
<given-names>K.</given-names>
</name>
<name><surname>Shenoy</surname>
<given-names>K. V.</given-names>
</name>
</person-group>
(<year>2011</year>
). <article-title>An optogenetic toolbox designed for primates</article-title>
. <source>Nat. Neurosci.</source>
<volume>14</volume>
, <fpage>387</fpage>
–<lpage>397</lpage>
<pub-id pub-id-type="doi">10.1038/nn.2749</pub-id>
<pub-id pub-id-type="pmid">21278729</pub-id>
</mixed-citation>
</ref>
<ref id="B25"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Dodd</surname>
<given-names>J. V.</given-names>
</name>
<name><surname>Krug</surname>
<given-names>K.</given-names>
</name>
<name><surname>Cumming</surname>
<given-names>B. G.</given-names>
</name>
<name><surname>Parker</surname>
<given-names>A. J.</given-names>
</name>
</person-group>
(<year>2001</year>
). <article-title>Perceptually bistable three-dimensional figures evoke high choice probabilities in cortical area MT</article-title>
. <source>J. Neurosci.</source>
<volume>21</volume>
, <fpage>4809</fpage>
–<lpage>4821</lpage>
<pub-id pub-id-type="pmid">11425908</pub-id>
</mixed-citation>
</ref>
<ref id="B26"><mixed-citation publication-type="book"><person-group person-group-type="author"><name><surname>Evarts</surname>
<given-names>E. V.</given-names>
</name>
</person-group>
(<year>1966</year>
). <article-title>“Methods for recording activity of individual neurons in moving animals”,</article-title>
in <source>Methods in Medical Research</source>
, ed. <person-group person-group-type="editor"><name><surname>Rushmer</surname>
<given-names>R. F.</given-names>
</name>
</person-group>
(<publisher-loc>Chicago</publisher-loc>
: <publisher-name>Year Book</publisher-name>
), <fpage>241</fpage>
–<lpage>250</lpage>
</mixed-citation>
</ref>
<ref id="B27"><mixed-citation publication-type="book"><person-group person-group-type="author"><name><surname>Fechner</surname>
<given-names>G. T.</given-names>
</name>
</person-group>
(<year>1860</year>
). <source>Elemente der Psychophysik</source>
. <publisher-loc>Leipzig</publisher-loc>
: <publisher-name>Breitkopf</publisher-name>
</mixed-citation>
</ref>
<ref id="B28"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Feierstein</surname>
<given-names>C. E.</given-names>
</name>
<name><surname>Quirk</surname>
<given-names>M. C.</given-names>
</name>
<name><surname>Uchida</surname>
<given-names>N.</given-names>
</name>
<name><surname>Sosulski</surname>
<given-names>D. L.</given-names>
</name>
<name><surname>Mainen</surname>
<given-names>Z. F.</given-names>
</name>
</person-group>
(<year>2006</year>
). <article-title>Representation of spatial goals in rat orbitofrontal cortex</article-title>
. <source>Neuron</source>
<volume>51</volume>
, <fpage>495</fpage>
–<lpage>507</lpage>
<pub-id pub-id-type="doi">10.1016/j.neuron.2006.06.032</pub-id>
<pub-id pub-id-type="pmid">16908414</pub-id>
</mixed-citation>
</ref>
<ref id="B29"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Feng</surname>
<given-names>S.</given-names>
</name>
<name><surname>Holmes</surname>
<given-names>P.</given-names>
</name>
<name><surname>Rorie</surname>
<given-names>A.</given-names>
</name>
<name><surname>Newsome</surname>
<given-names>W. T.</given-names>
</name>
</person-group>
(<year>2009</year>
). <article-title>Can monkeys choose optimally when faced with noisy stimuli and unequal rewards?</article-title>
<source>PLoS Comput. Biol.</source>
<volume>5</volume>
, <fpage>e1000284</fpage>
<pub-id pub-id-type="doi">10.1371/journal.pcbi.1000284</pub-id>
<pub-id pub-id-type="pmid">19214201</pub-id>
</mixed-citation>
</ref>
<ref id="B30"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Fine</surname>
<given-names>I.</given-names>
</name>
<name><surname>Jacobs</surname>
<given-names>R. A.</given-names>
</name>
</person-group>
(<year>2002</year>
). <article-title>Comparing perceptual learning tasks: a review</article-title>
. <source>J. Vis.</source>
<volume>2</volume>
, <fpage>190</fpage>
–<lpage>203</lpage>
<pub-id pub-id-type="doi">10.1167/2.10.66</pub-id>
<pub-id pub-id-type="pmid">12678592</pub-id>
</mixed-citation>
</ref>
<ref id="B31"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Frederick</surname>
<given-names>D. E.</given-names>
</name>
<name><surname>Rojas-Libano</surname>
<given-names>D.</given-names>
</name>
<name><surname>Scott</surname>
<given-names>M.</given-names>
</name>
<name><surname>Kay</surname>
<given-names>L. M.</given-names>
</name>
</person-group>
(<year>2011</year>
). <article-title>Rat behavior in go/no-go and two-alternative choice odor discrimination: differences and similarities</article-title>
. <source>Behav. Neurosci.</source>
<volume>125</volume>
, <fpage>588</fpage>
–<lpage>603</lpage>
<pub-id pub-id-type="doi">10.1037/a0024371</pub-id>
<pub-id pub-id-type="pmid">21787042</pub-id>
</mixed-citation>
</ref>
<ref id="B32"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Fruend</surname>
<given-names>I.</given-names>
</name>
<name><surname>Haenel</surname>
<given-names>N. V.</given-names>
</name>
<name><surname>Wichmann</surname>
<given-names>F. A.</given-names>
</name>
</person-group>
(<year>2011</year>
). <article-title>Inference for psychometric functions in the presence of nonstationary behavior</article-title>
. <source>J. Vis.</source>
<fpage>11</fpage>
<pub-id pub-id-type="doi">10.1167/11.6.16</pub-id>
</mixed-citation>
</ref>
<ref id="B33"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Furuta</surname>
<given-names>T.</given-names>
</name>
<name><surname>Urbain</surname>
<given-names>N.</given-names>
</name>
<name><surname>Kaneko</surname>
<given-names>T.</given-names>
</name>
<name><surname>Deschenes</surname>
<given-names>M.</given-names>
</name>
</person-group>
(<year>2010</year>
). <article-title>Corticofugal control of vibrissa-sensitive neurons in the interpolaris nucleus of the trigeminal complex</article-title>
. <source>J. Neurosci.</source>
<volume>30</volume>
, <fpage>1832</fpage>
–<lpage>1838</lpage>
<pub-id pub-id-type="doi">10.1523/JNEUROSCI.4274-09.2010</pub-id>
<pub-id pub-id-type="pmid">20130192</pub-id>
</mixed-citation>
</ref>
<ref id="B34"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Garcia-Perez</surname>
<given-names>M. A.</given-names>
</name>
<name><surname>Alcala-Quintana</surname>
<given-names>R.</given-names>
</name>
</person-group>
(<year>2011</year>
). <article-title>Interval bias in 2AFC detection tasks: sorting out the artifacts</article-title>
. <source>Atten. Percept. Psychophys.</source>
[Epub ahead of print].<pub-id pub-id-type="doi">10.3758/s13414-011-0167-x</pub-id>
</mixed-citation>
</ref>
<ref id="B35"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Geisler</surname>
<given-names>W. S.</given-names>
</name>
<name><surname>Albrecht</surname>
<given-names>D. G.</given-names>
</name>
</person-group>
(<year>1997</year>
). <article-title>Visual cortex neurons in monkeys and cats: detection, discrimination, and identification</article-title>
. <source>Vis. Neurosci.</source>
<volume>14</volume>
, <fpage>897</fpage>
–<lpage>919</lpage>
<pub-id pub-id-type="doi">10.1017/S0952523800011627</pub-id>
<pub-id pub-id-type="pmid">9364727</pub-id>
</mixed-citation>
</ref>
<ref id="B36"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Gerdjikov</surname>
<given-names>T. V.</given-names>
</name>
<name><surname>Bergner</surname>
<given-names>C. G.</given-names>
</name>
<name><surname>Stüttgen</surname>
<given-names>M. C.</given-names>
</name>
<name><surname>Waiblinger</surname>
<given-names>C.</given-names>
</name>
<name><surname>Schwarz</surname>
<given-names>C.</given-names>
</name>
</person-group>
(<year>2010</year>
). <article-title>Discrimination of vibrotactile stimuli in the rat whisker system: behavior and neurometrics</article-title>
. <source>Neuron</source>
<volume>65</volume>
, <fpage>530</fpage>
–<lpage>540</lpage>
<pub-id pub-id-type="doi">10.1016/j.neuron.2010.02.007</pub-id>
<pub-id pub-id-type="pmid">20188657</pub-id>
</mixed-citation>
</ref>
<ref id="B37"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Gold</surname>
<given-names>J. I.</given-names>
</name>
<name><surname>Shadlen</surname>
<given-names>M. N.</given-names>
</name>
</person-group>
(<year>2001</year>
). <article-title>Neural computations that underlie decisions about sensory stimuli</article-title>
. <source>Trends Cogn. Sci. (Regul. Ed.)</source>
<volume>5</volume>
, <fpage>10</fpage>
–<lpage>16</lpage>
<pub-id pub-id-type="doi">10.1016/S1364-6613(00)01567-9</pub-id>
<pub-id pub-id-type="pmid">11164731</pub-id>
</mixed-citation>
</ref>
<ref id="B38"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Gold</surname>
<given-names>J. I.</given-names>
</name>
<name><surname>Shadlen</surname>
<given-names>M. N.</given-names>
</name>
</person-group>
(<year>2007</year>
). <article-title>The neural basis of decision making</article-title>
. <source>Annu. Rev. Neurosci.</source>
<volume>30</volume>
, <fpage>535</fpage>
–<lpage>574</lpage>
<pub-id pub-id-type="doi">10.1146/annurev.neuro.29.051605.113038</pub-id>
<pub-id pub-id-type="pmid">17600525</pub-id>
</mixed-citation>
</ref>
<ref id="B39"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Gomez</surname>
<given-names>P.</given-names>
</name>
<name><surname>Ratcliff</surname>
<given-names>R.</given-names>
</name>
<name><surname>Perea</surname>
<given-names>M.</given-names>
</name>
</person-group>
(<year>2007</year>
). <article-title>A model of the go/no-go task</article-title>
. <source>J. Exp. Psychol. Gen.</source>
<volume>136</volume>
, <fpage>389</fpage>
–<lpage>413</lpage>
<pub-id pub-id-type="doi">10.1037/0096-3445.136.3.389</pub-id>
<pub-id pub-id-type="pmid">17696690</pub-id>
</mixed-citation>
</ref>
<ref id="B40"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Goto</surname>
<given-names>K.</given-names>
</name>
<name><surname>Kurashima</surname>
<given-names>R.</given-names>
</name>
<name><surname>Watanabe</surname>
<given-names>S.</given-names>
</name>
</person-group>
(<year>2010</year>
). <article-title>Delayed matching-to-position performance in C57BL/6N mice</article-title>
. <source>Behav. Processes</source>
<volume>84</volume>
, <fpage>591</fpage>
–<lpage>597</lpage>
<pub-id pub-id-type="doi">10.1016/j.beproc.2010.02.022</pub-id>
<pub-id pub-id-type="pmid">20211712</pub-id>
</mixed-citation>
</ref>
<ref id="B41"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Green</surname>
<given-names>D. M.</given-names>
</name>
<name><surname>Forrest</surname>
<given-names>T. G.</given-names>
</name>
</person-group>
(<year>1989</year>
). <article-title>Temporal gaps in noise and sinusoids</article-title>
. <source>J. Acoust. Soc. Am.</source>
<volume>86</volume>
, <fpage>961</fpage>
–<lpage>970</lpage>
<pub-id pub-id-type="doi">10.1121/1.398759</pub-id>
<pub-id pub-id-type="pmid">2794249</pub-id>
</mixed-citation>
</ref>
<ref id="B42"><mixed-citation publication-type="book"><person-group person-group-type="author"><name><surname>Green</surname>
<given-names>D. M.</given-names>
</name>
<name><surname>Swets</surname>
<given-names>J. A.</given-names>
</name>
</person-group>
(<year>1966</year>
). <source>Signal Detection Theory and Psychophysics</source>
. <publisher-loc>New York</publisher-loc>
: <publisher-name>Wiley</publisher-name>
</mixed-citation>
</ref>
<ref id="B43"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Green</surname>
<given-names>D. M.</given-names>
</name>
<name><surname>Weber</surname>
<given-names>D. L.</given-names>
</name>
</person-group>
(<year>1980</year>
). <article-title>Detection of temporally uncertain signals</article-title>
. <source>J. Acoust. Soc. Am.</source>
<volume>67</volume>
, <fpage>1304</fpage>
–<lpage>1311</lpage>
<pub-id pub-id-type="doi">10.1121/1.384183</pub-id>
<pub-id pub-id-type="pmid">7372917</pub-id>
</mixed-citation>
</ref>
<ref id="B44"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Haehnel</surname>
<given-names>M.</given-names>
</name>
<name><surname>Froese</surname>
<given-names>A.</given-names>
</name>
<name><surname>Menzel</surname>
<given-names>R.</given-names>
</name>
</person-group>
(<year>2009</year>
). <article-title>In vivo Ca2+− imaging of mushroom body neurons during olfactory learning in the honey bee</article-title>
. <source>J. Vis. Exp.</source>
<volume>30</volume>
, <fpage>e1353</fpage>
<pub-id pub-id-type="doi">10.3791/1353</pub-id>
</mixed-citation>
</ref>
<ref id="B45"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Harris</surname>
<given-names>J. A.</given-names>
</name>
<name><surname>Harris</surname>
<given-names>I. M.</given-names>
</name>
<name><surname>Diamond</surname>
<given-names>M. E.</given-names>
</name>
</person-group>
(<year>2001</year>
). <article-title>The topography of tactile working memory</article-title>
. <source>J. Neurosci.</source>
<volume>21</volume>
, <fpage>8262</fpage>
–<lpage>8269</lpage>
<pub-id pub-id-type="pmid">11588197</pub-id>
</mixed-citation>
</ref>
<ref id="B46"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Hautus</surname>
<given-names>M. J.</given-names>
</name>
<name><surname>van Hout</surname>
<given-names>D.</given-names>
</name>
<name><surname>Lee</surname>
<given-names>H. S.</given-names>
</name>
</person-group>
(<year>2009</year>
). <article-title>Variants of A Not-A and 2AFC tests: signal detection theory models</article-title>
. <source>Food Qual. Prefer.</source>
<volume>20</volume>
, <fpage>222</fpage>
–<lpage>229</lpage>
<pub-id pub-id-type="doi">10.1016/j.foodqual.2008.10.002</pub-id>
</mixed-citation>
</ref>
<ref id="B47"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Hecht</surname>
<given-names>S.</given-names>
</name>
<name><surname>Shlaer</surname>
<given-names>S.</given-names>
</name>
<name><surname>Pirenne</surname>
<given-names>M. H.</given-names>
</name>
</person-group>
(<year>1942</year>
). <article-title>Energy, quanta, and vision</article-title>
. <source>J. Gen. Physiol.</source>
<volume>25</volume>
, <fpage>819</fpage>
–<lpage>840</lpage>
<pub-id pub-id-type="doi">10.1085/jgp.25.6.819</pub-id>
<pub-id pub-id-type="pmid">19873316</pub-id>
</mixed-citation>
</ref>
<ref id="B48"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Hernandez</surname>
<given-names>A.</given-names>
</name>
<name><surname>Salinas</surname>
<given-names>E.</given-names>
</name>
<name><surname>Garcia</surname>
<given-names>R.</given-names>
</name>
<name><surname>Romo</surname>
<given-names>R.</given-names>
</name>
</person-group>
(<year>1997</year>
). <article-title>Discrimination in the sense of flutter: new psychophysical measurements in monkeys</article-title>
. <source>J. Neurosci.</source>
<volume>17</volume>
, <fpage>6391</fpage>
–<lpage>6400</lpage>
<pub-id pub-id-type="pmid">9236247</pub-id>
</mixed-citation>
</ref>
<ref id="B49"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Hernandez</surname>
<given-names>A.</given-names>
</name>
<name><surname>Zainos</surname>
<given-names>A.</given-names>
</name>
<name><surname>Romo</surname>
<given-names>R.</given-names>
</name>
</person-group>
(<year>2000</year>
). <article-title>Neuronal correlates of sensory discrimination in the somatosensory cortex</article-title>
. <source>Proc. Natl. Acad. Sci. U.S.A.</source>
<volume>97</volume>
, <fpage>6191</fpage>
–<lpage>6196</lpage>
<pub-id pub-id-type="doi">10.1073/pnas.040569697</pub-id>
<pub-id pub-id-type="pmid">10811922</pub-id>
</mixed-citation>
</ref>
<ref id="B50"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Heuer</surname>
<given-names>H. W.</given-names>
</name>
<name><surname>Britten</surname>
<given-names>K. H.</given-names>
</name>
</person-group>
(<year>2004</year>
). <article-title>Optic flow signals in extrastriate area MST: comparison of perceptual and neuronal sensitivity</article-title>
. <source>J. Neurophysiol.</source>
<volume>91</volume>
, <fpage>1314</fpage>
–<lpage>1326</lpage>
<pub-id pub-id-type="doi">10.1152/jn.00637.2003</pub-id>
<pub-id pub-id-type="pmid">14534287</pub-id>
</mixed-citation>
</ref>
<ref id="B51"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Houweling</surname>
<given-names>A. R.</given-names>
</name>
<name><surname>Brecht</surname>
<given-names>M.</given-names>
</name>
</person-group>
(<year>2008</year>
). <article-title>Behavioural report of single neuron stimulation in somatosensory cortex</article-title>
. <source>Nature</source>
<volume>451</volume>
, <fpage>65</fpage>
–<lpage>68</lpage>
<pub-id pub-id-type="doi">10.1038/nature06447</pub-id>
<pub-id pub-id-type="pmid">18094684</pub-id>
</mixed-citation>
</ref>
<ref id="B52"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Houweling</surname>
<given-names>A. R.</given-names>
</name>
<name><surname>Doron</surname>
<given-names>G.</given-names>
</name>
<name><surname>Voigt</surname>
<given-names>B. C.</given-names>
</name>
<name><surname>Herfst</surname>
<given-names>L. J.</given-names>
</name>
<name><surname>Brecht</surname>
<given-names>M.</given-names>
</name>
</person-group>
(<year>2010</year>
). <article-title>Nanostimulation: manipulation of single neuron activity by juxtacellular current injection</article-title>
. <source>J. Neurophysiol.</source>
<volume>103</volume>
, <fpage>1696</fpage>
–<lpage>1704</lpage>
<pub-id pub-id-type="doi">10.1152/jn.00421.2009</pub-id>
<pub-id pub-id-type="pmid">19955285</pub-id>
</mixed-citation>
</ref>
<ref id="B53"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Jacobs</surname>
<given-names>A. L.</given-names>
</name>
<name><surname>Fridman</surname>
<given-names>G.</given-names>
</name>
<name><surname>Douglas</surname>
<given-names>R. M.</given-names>
</name>
<name><surname>Alam</surname>
<given-names>N. M.</given-names>
</name>
<name><surname>Latham</surname>
<given-names>P. E.</given-names>
</name>
<name><surname>Prusky</surname>
<given-names>G. T.</given-names>
</name>
<name><surname>Nirenberg</surname>
<given-names>S.</given-names>
</name>
</person-group>
(<year>2009</year>
). <article-title>Ruling out and ruling in neural codes</article-title>
. <source>Proc. Natl. Acad. Sci. U.S.A.</source>
<volume>106</volume>
, <fpage>5936</fpage>
–<lpage>5941</lpage>
<pub-id pub-id-type="doi">10.1073/pnas.0912152106</pub-id>
<pub-id pub-id-type="pmid">19297621</pub-id>
</mixed-citation>
</ref>
<ref id="B54"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Jäkel</surname>
<given-names>F.</given-names>
</name>
<name><surname>Wichmann</surname>
<given-names>F. A.</given-names>
</name>
</person-group>
(<year>2006</year>
). <article-title>Spatial four-alternative forced-choice method is the preferred psychophysical method for naive observers</article-title>
. <source>J. Vis.</source>
<volume>6</volume>
, <fpage>1307</fpage>
–<lpage>1322</lpage>
<pub-id pub-id-type="doi">10.1167/6.11.13</pub-id>
<pub-id pub-id-type="pmid">17209737</pub-id>
</mixed-citation>
</ref>
<ref id="B55"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Jang</surname>
<given-names>Y.</given-names>
</name>
<name><surname>Wixted</surname>
<given-names>J. T.</given-names>
</name>
<name><surname>Huber</surname>
<given-names>D. E.</given-names>
</name>
</person-group>
(<year>2009</year>
). <article-title>Testing signal-detection models of yes/no and two-alternative forced-choice recognition memory</article-title>
. <source>J. Exp. Psychol. Gen.</source>
<volume>138</volume>
, <fpage>291</fpage>
–<lpage>306</lpage>
<pub-id pub-id-type="doi">10.1037/a0015525</pub-id>
<pub-id pub-id-type="pmid">19397385</pub-id>
</mixed-citation>
</ref>
<ref id="B56"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Johansson</surname>
<given-names>R. S.</given-names>
</name>
<name><surname>Vallbo</surname>
<given-names>A. B.</given-names>
</name>
</person-group>
(<year>1979</year>
). <article-title>Detection of tactile stimuli. Thresholds of afferent units related to psychophysical thresholds in the human hand</article-title>
. <source>J. Physiol.</source>
<volume>297</volume>
, <fpage>405</fpage>
–<lpage>422</lpage>
<pub-id pub-id-type="pmid">536918</pub-id>
</mixed-citation>
</ref>
<ref id="B57"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Kepecs</surname>
<given-names>A.</given-names>
</name>
<name><surname>Uchida</surname>
<given-names>N.</given-names>
</name>
<name><surname>Zariwala</surname>
<given-names>H. A.</given-names>
</name>
<name><surname>Mainen</surname>
<given-names>Z. F.</given-names>
</name>
</person-group>
(<year>2008</year>
). <article-title>Neural correlates, computation and behavioural impact of decision confidence</article-title>
. <source>Nature</source>
<volume>455</volume>
, <fpage>227</fpage>
–<lpage>231</lpage>
<pub-id pub-id-type="doi">10.1038/nature07200</pub-id>
<pub-id pub-id-type="pmid">18690210</pub-id>
</mixed-citation>
</ref>
<ref id="B58"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Kesner</surname>
<given-names>R. P.</given-names>
</name>
<name><surname>Hunt</surname>
<given-names>M. E.</given-names>
</name>
<name><surname>Williams</surname>
<given-names>J. M.</given-names>
</name>
<name><surname>Long</surname>
<given-names>J. M.</given-names>
</name>
</person-group>
(<year>1996</year>
). <article-title>Prefrontal cortex and working memory for spatial response, spatial location, and visual object information in the rat</article-title>
. <source>Cereb. Cortex</source>
<volume>6</volume>
, <fpage>311</fpage>
–<lpage>318</lpage>
<pub-id pub-id-type="doi">10.1093/cercor/6.2.311</pub-id>
<pub-id pub-id-type="pmid">8670659</pub-id>
</mixed-citation>
</ref>
<ref id="B59"><mixed-citation publication-type="book"><person-group person-group-type="author"><name><surname>Kingdom</surname>
<given-names>F. A. A.</given-names>
</name>
<name><surname>Prins</surname>
<given-names>N.</given-names>
</name>
</person-group>
(<year>2010</year>
). <source>Psychophysics: A Practical Introduction</source>
. <publisher-loc>London</publisher-loc>
: <publisher-name>Academic Press</publisher-name>
</mixed-citation>
</ref>
<ref id="B60"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Klein</surname>
<given-names>S. A.</given-names>
</name>
</person-group>
(<year>2001</year>
). <article-title>Measuring, estimating, and understanding the psychometric function: a commentary</article-title>
. <source>Percept. Psychophys.</source>
<volume>63</volume>
, <fpage>1421</fpage>
–<lpage>1455</lpage>
<pub-id pub-id-type="doi">10.3758/BF03194552</pub-id>
<pub-id pub-id-type="pmid">11800466</pub-id>
</mixed-citation>
</ref>
<ref id="B61"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Knutsen</surname>
<given-names>P. M.</given-names>
</name>
<name><surname>Pietr</surname>
<given-names>M.</given-names>
</name>
<name><surname>Ahissar</surname>
<given-names>E.</given-names>
</name>
</person-group>
(<year>2006</year>
). <article-title>Haptic object localization in the vibrissal system: behavior and performance</article-title>
. <source>J. Neurosci.</source>
<volume>26</volume>
, <fpage>8451</fpage>
–<lpage>8464</lpage>
<pub-id pub-id-type="pmid">16914670</pub-id>
</mixed-citation>
</ref>
<ref id="B62"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Krupa</surname>
<given-names>D. J.</given-names>
</name>
<name><surname>Matell</surname>
<given-names>M. S.</given-names>
</name>
<name><surname>Brisben</surname>
<given-names>A. J.</given-names>
</name>
<name><surname>Oliveira</surname>
<given-names>L. M.</given-names>
</name>
<name><surname>Nicolelis</surname>
<given-names>M. A.</given-names>
</name>
</person-group>
(<year>2001</year>
). <article-title>Behavioral properties of the trigeminal somatosensory system in rats performing whisker-dependent tactile discriminations</article-title>
. <source>J. Neurosci.</source>
<volume>21</volume>
, <fpage>5752</fpage>
–<lpage>5763</lpage>
<pub-id pub-id-type="pmid">11466447</pub-id>
</mixed-citation>
</ref>
<ref id="B63"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Lages</surname>
<given-names>M.</given-names>
</name>
<name><surname>Treisman</surname>
<given-names>M.</given-names>
</name>
</person-group>
(<year>1998</year>
). <article-title>Spatial frequency discrimination: visual long-term memory or criterion setting?</article-title>
<source>Vision Res.</source>
<volume>38</volume>
, <fpage>557</fpage>
–<lpage>572</lpage>
<pub-id pub-id-type="doi">10.1016/S0042-6989(97)88333-2</pub-id>
<pub-id pub-id-type="pmid">9536378</pub-id>
</mixed-citation>
</ref>
<ref id="B64"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Lee</surname>
<given-names>H. S.</given-names>
</name>
<name><surname>van Hout</surname>
<given-names>D.</given-names>
</name>
<name><surname>Hautus</surname>
<given-names>M. J.</given-names>
</name>
</person-group>
(<year>2007</year>
). <article-title>Comparison of performance in the A-Not A, 2-AFC, and same-different tests for the flavor discrimination of margarines: the effect of cognitive decision strategies</article-title>
. <source>Food Qual. Prefer.</source>
<volume>18</volume>
, <fpage>920</fpage>
–<lpage>928</lpage>
<pub-id pub-id-type="doi">10.1016/j.foodqual.2006.10.003</pub-id>
</mixed-citation>
</ref>
<ref id="B65"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Lissek</surname>
<given-names>S.</given-names>
</name>
<name><surname>Güntürkün</surname>
<given-names>O.</given-names>
</name>
</person-group>
(<year>2004</year>
). <article-title>Maintenance in working memory or response selection? Functions of NMDA receptors in the pigeon “prefrontal cortex.”</article-title>
<source>Behav. Brain Res.</source>
<volume>153</volume>
, <fpage>497</fpage>
–<lpage>506</lpage>
<pub-id pub-id-type="doi">10.1016/j.bbr.2004.01.007</pub-id>
<pub-id pub-id-type="pmid">15265648</pub-id>
</mixed-citation>
</ref>
<ref id="B66"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Luna</surname>
<given-names>R.</given-names>
</name>
<name><surname>Hernandez</surname>
<given-names>A.</given-names>
</name>
<name><surname>Brody</surname>
<given-names>C. D.</given-names>
</name>
<name><surname>Romo</surname>
<given-names>R.</given-names>
</name>
</person-group>
(<year>2005</year>
). <article-title>Neural codes for perceptual discrimination in primary somatosensory cortex</article-title>
. <source>Nat. Neurosci.</source>
<volume>8</volume>
, <fpage>1210</fpage>
–<lpage>1219</lpage>
<pub-id pub-id-type="doi">10.1038/nn1513</pub-id>
<pub-id pub-id-type="pmid">16056223</pub-id>
</mixed-citation>
</ref>
<ref id="B67"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Machens</surname>
<given-names>C. K.</given-names>
</name>
<name><surname>Romo</surname>
<given-names>R.</given-names>
</name>
<name><surname>Brody</surname>
<given-names>C. D.</given-names>
</name>
</person-group>
(<year>2005</year>
). <article-title>Flexible control of mutual inhibition: a neural model of two-interval discrimination</article-title>
. <source>Science</source>
<volume>307</volume>
, <fpage>1121</fpage>
–<lpage>1124</lpage>
<pub-id pub-id-type="doi">10.1126/science.1104171</pub-id>
<pub-id pub-id-type="pmid">15718474</pub-id>
</mixed-citation>
</ref>
<ref id="B68"><mixed-citation publication-type="book"><person-group person-group-type="author"><name><surname>MacMillan</surname>
<given-names>N. A.</given-names>
</name>
<name><surname>Creelman</surname>
<given-names>C. D.</given-names>
</name>
</person-group>
(<year>2005</year>
). <source>Detection Theory: A User’s Guide</source>
(<publisher-loc>Mahwah, NJ</publisher-loc>
: <publisher-name>Lawrence Erlbaum Associates, Inc.</publisher-name>
).</mixed-citation>
</ref>
<ref id="B69"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>McCarthy</surname>
<given-names>D.</given-names>
</name>
<name><surname>Davison</surname>
<given-names>M.</given-names>
</name>
</person-group>
(<year>1981</year>
). <article-title>Towards a behavioral-theory of bias in signal-detection</article-title>
. <source>Percept. Psychophys.</source>
<volume>29</volume>
, <fpage>371</fpage>
–<lpage>382</lpage>
<pub-id pub-id-type="doi">10.3758/BF03207347</pub-id>
<pub-id pub-id-type="pmid">7279561</pub-id>
</mixed-citation>
</ref>
<ref id="B70"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Mehta</surname>
<given-names>S. B.</given-names>
</name>
<name><surname>Whitmer</surname>
<given-names>D.</given-names>
</name>
<name><surname>Figueroa</surname>
<given-names>R.</given-names>
</name>
<name><surname>Williams</surname>
<given-names>B. A.</given-names>
</name>
<name><surname>Kleinfeld</surname>
<given-names>D.</given-names>
</name>
</person-group>
(<year>2007</year>
). <article-title>Active spatial perception in the vibrissa scanning sensorimotor system</article-title>
. <source>PLoS Biol.</source>
<volume>5</volume>
, <fpage>e15</fpage>
<pub-id pub-id-type="doi">10.1371/journal.pbio.0050015</pub-id>
<pub-id pub-id-type="pmid">17227143</pub-id>
</mixed-citation>
</ref>
<ref id="B71"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Mentzer</surname>
<given-names>T. L.</given-names>
</name>
</person-group>
(<year>1966</year>
). <article-title>Comparison of three methods for obtaining psychophysical thresholds from the pigeon</article-title>
. <source>J. Comp. Physiol. Psychol.</source>
<volume>61</volume>
, <fpage>96</fpage>
–<lpage>101</lpage>
<pub-id pub-id-type="doi">10.1037/h0022814</pub-id>
<pub-id pub-id-type="pmid">5948232</pub-id>
</mixed-citation>
</ref>
<ref id="B72"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Menzel</surname>
<given-names>R.</given-names>
</name>
<name><surname>Giurfa</surname>
<given-names>M.</given-names>
</name>
</person-group>
(<year>2001</year>
). <article-title>Cognitive architecture of a mini-brain: the honeybee</article-title>
. <source>Trends Cogn. Sci. (Regul. Ed.)</source>
<volume>5</volume>
, <fpage>62</fpage>
–<lpage>71</lpage>
<pub-id pub-id-type="doi">10.1016/S1364-6613(00)01601-6</pub-id>
<pub-id pub-id-type="pmid">11166636</pub-id>
</mixed-citation>
</ref>
<ref id="B73"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Mountcastle</surname>
<given-names>V. B.</given-names>
</name>
<name><surname>Steinmetz</surname>
<given-names>M. A.</given-names>
</name>
<name><surname>Romo</surname>
<given-names>R.</given-names>
</name>
</person-group>
(<year>1990</year>
). <article-title>Frequency discrimination in the sense of flutter: psychophysical measurements correlated with postcentral events in behaving monkeys</article-title>
. <source>J. Neurosci.</source>
<volume>10</volume>
, <fpage>3032</fpage>
–<lpage>3044</lpage>
<pub-id pub-id-type="pmid">2118947</pub-id>
</mixed-citation>
</ref>
<ref id="B74"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Nachmias</surname>
<given-names>J.</given-names>
</name>
</person-group>
(<year>2006</year>
). <article-title>The role of virtual standards in visual discrimination</article-title>
. <source>Vision Res.</source>
<volume>46</volume>
, <fpage>2456</fpage>
–<lpage>2464</lpage>
<pub-id pub-id-type="doi">10.1016/j.visres.2006.01.029</pub-id>
<pub-id pub-id-type="pmid">16530243</pub-id>
</mixed-citation>
</ref>
<ref id="B75"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Newsome</surname>
<given-names>W. T.</given-names>
</name>
<name><surname>Britten</surname>
<given-names>K. H.</given-names>
</name>
<name><surname>Movshon</surname>
<given-names>J. A.</given-names>
</name>
</person-group>
(<year>1989</year>
). <article-title>Neuronal correlates of a perceptual decision</article-title>
. <source>Nature</source>
<volume>341</volume>
, <fpage>52</fpage>
–<lpage>54</lpage>
<pub-id pub-id-type="doi">10.1038/341052a0</pub-id>
<pub-id pub-id-type="pmid">2770878</pub-id>
</mixed-citation>
</ref>
<ref id="B76"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Nienborg</surname>
<given-names>H.</given-names>
</name>
<name><surname>Cumming</surname>
<given-names>B.</given-names>
</name>
</person-group>
(<year>2010</year>
). <article-title>Correlations between the activity of sensory neurons and behavior: how much do they tell us about a neuron’s causality?</article-title>
<source>Curr. Opin. Neurobiol.</source>
<volume>20</volume>
, <fpage>376</fpage>
–<lpage>381</lpage>
<pub-id pub-id-type="doi">10.1016/j.conb.2010.05.002</pub-id>
<pub-id pub-id-type="pmid">20545019</pub-id>
</mixed-citation>
</ref>
<ref id="B77"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Nienborg</surname>
<given-names>H.</given-names>
</name>
<name><surname>Cumming</surname>
<given-names>B. G.</given-names>
</name>
</person-group>
(<year>2006</year>
). <article-title>Macaque V2 neurons, but not V1 neurons, show choice-related activity</article-title>
. <source>J. Neurosci.</source>
<volume>26</volume>
, <fpage>9567</fpage>
–<lpage>9578</lpage>
<pub-id pub-id-type="doi">10.1523/JNEUROSCI.2256-06.2006</pub-id>
<pub-id pub-id-type="pmid">16971541</pub-id>
</mixed-citation>
</ref>
<ref id="B78"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Nienborg</surname>
<given-names>H.</given-names>
</name>
<name><surname>Cumming</surname>
<given-names>B. G.</given-names>
</name>
</person-group>
(<year>2007</year>
). <article-title>Psychophysically measured task strategy for disparity discrimination is reflected in V2 neurons</article-title>
. <source>Nat. Neurosci.</source>
<volume>10</volume>
, <fpage>1608</fpage>
–<lpage>1614</lpage>
<pub-id pub-id-type="doi">10.1038/nn1991</pub-id>
<pub-id pub-id-type="pmid">17965712</pub-id>
</mixed-citation>
</ref>
<ref id="B79"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Nienborg</surname>
<given-names>H.</given-names>
</name>
<name><surname>Cumming</surname>
<given-names>B. G.</given-names>
</name>
</person-group>
(<year>2009</year>
). <article-title>Decision-related activity in sensory neurons reflects more than a neuron’s causal effect</article-title>
. <source>Nature</source>
<volume>459</volume>
, <fpage>89</fpage>
–<lpage>93</lpage>
<pub-id pub-id-type="doi">10.1038/nature07821</pub-id>
<pub-id pub-id-type="pmid">19270683</pub-id>
</mixed-citation>
</ref>
<ref id="B80"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Ochoa</surname>
<given-names>J.</given-names>
</name>
<name><surname>Torebjork</surname>
<given-names>E.</given-names>
</name>
</person-group>
(<year>1983</year>
). <article-title>Sensations evoked by intraneural microstimulation of single mechanoreceptor units innervating the human hand</article-title>
. <source>J. Physiol.</source>
<volume>342</volume>
, <fpage>633</fpage>
–<lpage>654</lpage>
<pub-id pub-id-type="pmid">6631752</pub-id>
</mixed-citation>
</ref>
<ref id="B81"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>O’Connor</surname>
<given-names>D. H.</given-names>
</name>
<name><surname>Clack</surname>
<given-names>N. G.</given-names>
</name>
<name><surname>Huber</surname>
<given-names>D.</given-names>
</name>
<name><surname>Komiyama</surname>
<given-names>T.</given-names>
</name>
<name><surname>Myers</surname>
<given-names>E. W.</given-names>
</name>
<name><surname>Svoboda</surname>
<given-names>K.</given-names>
</name>
</person-group>
(<year>2010a</year>
). <article-title>Vibrissa-based object localization in head-fixed mice</article-title>
. <source>J. Neurosci.</source>
<volume>30</volume>
, <fpage>1947</fpage>
–<lpage>1967</lpage>
<pub-id pub-id-type="doi">10.1523/JNEUROSCI.4225-09.2010</pub-id>
</mixed-citation>
</ref>
<ref id="B82"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>O’Connor</surname>
<given-names>D. H.</given-names>
</name>
<name><surname>Peron</surname>
<given-names>S. P.</given-names>
</name>
<name><surname>Huber</surname>
<given-names>D.</given-names>
</name>
<name><surname>Svoboda</surname>
<given-names>K.</given-names>
</name>
</person-group>
(<year>2010b</year>
). <article-title>Neural activity in barrel cortex underlying vibrissa-based object localization in mice</article-title>
. <source>Neuron</source>
<volume>67</volume>
, <fpage>1048</fpage>
–<lpage>1061</lpage>
<pub-id pub-id-type="doi">10.1016/j.neuron.2010.08.026</pub-id>
</mixed-citation>
</ref>
<ref id="B83"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Ohiorhenuan</surname>
<given-names>I. E.</given-names>
</name>
<name><surname>Mechler</surname>
<given-names>F.</given-names>
</name>
<name><surname>Purpura</surname>
<given-names>K. P.</given-names>
</name>
<name><surname>Schmid</surname>
<given-names>A. M.</given-names>
</name>
<name><surname>Hu</surname>
<given-names>Q.</given-names>
</name>
<name><surname>Victor</surname>
<given-names>J. D.</given-names>
</name>
</person-group>
(<year>2010</year>
). <article-title>Sparse coding and high-order correlations in fine-scale cortical networks</article-title>
. <source>Nature</source>
<volume>466</volume>
, <fpage>617</fpage>
–<lpage>621</lpage>
<pub-id pub-id-type="doi">10.1038/nature09178</pub-id>
<pub-id pub-id-type="pmid">20601940</pub-id>
</mixed-citation>
</ref>
<ref id="B84"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Palmer</surname>
<given-names>C.</given-names>
</name>
<name><surname>Cheng</surname>
<given-names>S. Y.</given-names>
</name>
<name><surname>Seidemann</surname>
<given-names>E.</given-names>
</name>
</person-group>
(<year>2007</year>
). <article-title>Linking neuronal and behavioral performance in a reaction-time visual detection task</article-title>
. <source>J. Neurosci.</source>
<volume>27</volume>
, <fpage>8122</fpage>
–<lpage>8137</lpage>
<pub-id pub-id-type="doi">10.1523/JNEUROSCI.1940-07.2007</pub-id>
<pub-id pub-id-type="pmid">17652603</pub-id>
</mixed-citation>
</ref>
<ref id="B85"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Parker</surname>
<given-names>A. J.</given-names>
</name>
<name><surname>Newsome</surname>
<given-names>W. T.</given-names>
</name>
</person-group>
(<year>1998</year>
). <article-title>Sense and the single neuron: probing the physiology of perception</article-title>
. <source>Annu. Rev. Neurosci.</source>
<volume>21</volume>
, <fpage>227</fpage>
–<lpage>277</lpage>
<pub-id pub-id-type="doi">10.1146/annurev.neuro.21.1.227</pub-id>
<pub-id pub-id-type="pmid">9530497</pub-id>
</mixed-citation>
</ref>
<ref id="B86"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Polley</surname>
<given-names>D. B.</given-names>
</name>
<name><surname>Heiser</surname>
<given-names>M. A.</given-names>
</name>
<name><surname>Blake</surname>
<given-names>D. T.</given-names>
</name>
<name><surname>Schreiner</surname>
<given-names>C. E.</given-names>
</name>
<name><surname>Merzenich</surname>
<given-names>M. M.</given-names>
</name>
</person-group>
(<year>2004</year>
). <article-title>Associative learning shapes the neural code for stimulus magnitude in primary auditory cortex</article-title>
. <source>Proc. Natl. Acad. Sci. U.S.A.</source>
<volume>101</volume>
, <fpage>16351</fpage>
–<lpage>16356</lpage>
<pub-id pub-id-type="doi">10.1073/pnas.0407586101</pub-id>
<pub-id pub-id-type="pmid">15534214</pub-id>
</mixed-citation>
</ref>
<ref id="B87"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Pompilio</surname>
<given-names>L.</given-names>
</name>
<name><surname>Kacelnik</surname>
<given-names>A.</given-names>
</name>
<name><surname>Behmer</surname>
<given-names>S. T.</given-names>
</name>
</person-group>
(<year>2006</year>
). <article-title>State-dependent learned valuation drives choice in an invertebrate</article-title>
. <source>Science</source>
<volume>311</volume>
, <fpage>1613</fpage>
–<lpage>1615</lpage>
<pub-id pub-id-type="doi">10.1126/science.1123924</pub-id>
<pub-id pub-id-type="pmid">16543461</pub-id>
</mixed-citation>
</ref>
<ref id="B88"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Poulton</surname>
<given-names>E. C.</given-names>
</name>
</person-group>
(<year>1975</year>
). <article-title>Range effects in experiments on people</article-title>
. <source>Am. J. Psychol.</source>
<volume>88</volume>
, <fpage>3</fpage>
–<lpage>32</lpage>
<pub-id pub-id-type="doi">10.2307/1421662</pub-id>
</mixed-citation>
</ref>
<ref id="B89"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Prigg</surname>
<given-names>T.</given-names>
</name>
<name><surname>Goldreich</surname>
<given-names>D.</given-names>
</name>
<name><surname>Carvell</surname>
<given-names>G. E.</given-names>
</name>
<name><surname>Simons</surname>
<given-names>D. J.</given-names>
</name>
</person-group>
(<year>2002</year>
). <article-title>Texture discrimination and unit recordings in the rat whisker/barrel system</article-title>
. <source>Physiol. Behav.</source>
<volume>77</volume>
, <fpage>671</fpage>
–<lpage>675</lpage>
<pub-id pub-id-type="doi">10.1016/S0031-9384(02)00917-4</pub-id>
<pub-id pub-id-type="pmid">12527017</pub-id>
</mixed-citation>
</ref>
<ref id="B90"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Purushothaman</surname>
<given-names>G.</given-names>
</name>
<name><surname>Bradley</surname>
<given-names>D. C.</given-names>
</name>
</person-group>
(<year>2005</year>
). <article-title>Neural population code for fine perceptual decisions in area MT</article-title>
. <source>Nat. Neurosci.</source>
<volume>8</volume>
, <fpage>99</fpage>
–<lpage>106</lpage>
<pub-id pub-id-type="doi">10.1038/nn1373</pub-id>
<pub-id pub-id-type="pmid">15608633</pub-id>
</mixed-citation>
</ref>
<ref id="B91"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Qin</surname>
<given-names>L.</given-names>
</name>
<name><surname>Liu</surname>
<given-names>Y. C.</given-names>
</name>
<name><surname>Wang</surname>
<given-names>J. Y.</given-names>
</name>
<name><surname>Li</surname>
<given-names>S. N.</given-names>
</name>
<name><surname>Sato</surname>
<given-names>Y.</given-names>
</name>
</person-group>
(<year>2009</year>
). <article-title>Neural and behavioral discrimination of sound duration by cats</article-title>
. <source>J. Neurosci.</source>
<volume>29</volume>
, <fpage>15650</fpage>
–<lpage>15659</lpage>
<pub-id pub-id-type="doi">10.1523/JNEUROSCI.0420-09.2009</pub-id>
<pub-id pub-id-type="pmid">20016079</pub-id>
</mixed-citation>
</ref>
<ref id="B92"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Resulaj</surname>
<given-names>A.</given-names>
</name>
<name><surname>Kiani</surname>
<given-names>R.</given-names>
</name>
<name><surname>Wolpert</surname>
<given-names>D. M.</given-names>
</name>
<name><surname>Shadlen</surname>
<given-names>M. N.</given-names>
</name>
</person-group>
(<year>2009</year>
). <article-title>Changes of mind in decision-making</article-title>
. <source>Nature</source>
<volume>461</volume>
, <fpage>263</fpage>
–<lpage>266</lpage>
<pub-id pub-id-type="doi">10.1038/nature08275</pub-id>
<pub-id pub-id-type="pmid">19693010</pub-id>
</mixed-citation>
</ref>
<ref id="B93"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Riehle</surname>
<given-names>A.</given-names>
</name>
<name><surname>Grun</surname>
<given-names>S.</given-names>
</name>
<name><surname>Diesmann</surname>
<given-names>M.</given-names>
</name>
<name><surname>Aertsen</surname>
<given-names>A.</given-names>
</name>
</person-group>
(<year>1997</year>
). <article-title>Spike synchronization and rate modulation differentially involved in motor cortical function</article-title>
. <source>Science</source>
<volume>278</volume>
, <fpage>1950</fpage>
–<lpage>1953</lpage>
<pub-id pub-id-type="doi">10.1126/science.278.5345.1950</pub-id>
<pub-id pub-id-type="pmid">9395398</pub-id>
</mixed-citation>
</ref>
<ref id="B94"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Roeder</surname>
<given-names>K. D.</given-names>
</name>
</person-group>
(<year>1966</year>
). <article-title>Auditory system of noctuid moths</article-title>
. <source>Science</source>
<volume>154</volume>
, <fpage>1515</fpage>
–<lpage>1521</lpage>
<pub-id pub-id-type="doi">10.1126/science.154.3756.1515</pub-id>
<pub-id pub-id-type="pmid">5924920</pub-id>
</mixed-citation>
</ref>
<ref id="B95"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Roitman</surname>
<given-names>J. D.</given-names>
</name>
<name><surname>Shadlen</surname>
<given-names>M. N.</given-names>
</name>
</person-group>
(<year>2002</year>
). <article-title>Response of neurons in the lateral intraparietal area during a combined visual discrimination reaction time task</article-title>
. <source>J. Neurosci.</source>
<volume>22</volume>
, <fpage>9475</fpage>
–<lpage>9489</lpage>
<pub-id pub-id-type="pmid">12417672</pub-id>
</mixed-citation>
</ref>
<ref id="B96"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Romo</surname>
<given-names>R.</given-names>
</name>
<name><surname>Brody</surname>
<given-names>C. D.</given-names>
</name>
<name><surname>Hernandez</surname>
<given-names>A.</given-names>
</name>
<name><surname>Lemus</surname>
<given-names>L.</given-names>
</name>
</person-group>
(<year>1999</year>
). <article-title>Neuronal correlates of parametric working memory in the prefrontal cortex</article-title>
. <source>Nature</source>
<volume>399</volume>
, <fpage>470</fpage>
–<lpage>473</lpage>
<pub-id pub-id-type="doi">10.1038/20939</pub-id>
<pub-id pub-id-type="pmid">10365959</pub-id>
</mixed-citation>
</ref>
<ref id="B97"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Romo</surname>
<given-names>R.</given-names>
</name>
<name><surname>Salinas</surname>
<given-names>E.</given-names>
</name>
</person-group>
(<year>2003</year>
). <article-title>Flutter discrimination: neural codes, perception, memory and decision making</article-title>
. <source>Nat. Rev. Neurosci.</source>
<volume>4</volume>
, <fpage>203</fpage>
–<lpage>218</lpage>
<pub-id pub-id-type="doi">10.1038/nrn1058</pub-id>
<pub-id pub-id-type="pmid">12612633</pub-id>
</mixed-citation>
</ref>
<ref id="B98"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Rorie</surname>
<given-names>A. E.</given-names>
</name>
<name><surname>Gao</surname>
<given-names>J.</given-names>
</name>
<name><surname>McClelland</surname>
<given-names>J. L.</given-names>
</name>
<name><surname>Newsome</surname>
<given-names>W. T.</given-names>
</name>
</person-group>
(<year>2010</year>
). <article-title>Integration of sensory and reward information during perceptual decision-making in lateral intraparietal cortex (LIP) of the macaque monkey</article-title>
. <source>PLoS ONE</source>
<volume>5</volume>
, <fpage>e9308</fpage>
<pub-id pub-id-type="doi">10.1371/journal.pone.0009308</pub-id>
<pub-id pub-id-type="pmid">20174574</pub-id>
</mixed-citation>
</ref>
<ref id="B99"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Sakitt</surname>
<given-names>B.</given-names>
</name>
</person-group>
(<year>1972</year>
). <article-title>Counting every quantum</article-title>
. <source>J. Physiol.</source>
<volume>223</volume>
, <fpage>131</fpage>
–<lpage>150</lpage>
<pub-id pub-id-type="pmid">5046137</pub-id>
</mixed-citation>
</ref>
<ref id="B100"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Salinas</surname>
<given-names>E.</given-names>
</name>
<name><surname>Hernandez</surname>
<given-names>A.</given-names>
</name>
<name><surname>Zainos</surname>
<given-names>A.</given-names>
</name>
<name><surname>Romo</surname>
<given-names>R.</given-names>
</name>
</person-group>
(<year>2000</year>
). <article-title>Periodicity and firing rate as candidate neural codes for the frequency of vibrotactile stimuli</article-title>
. <source>J. Neurosci.</source>
<volume>20</volume>
, <fpage>5503</fpage>
–<lpage>5515</lpage>
<pub-id pub-id-type="pmid">10884334</pub-id>
</mixed-citation>
</ref>
<ref id="B101"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Schneidman</surname>
<given-names>E.</given-names>
</name>
<name><surname>Berry</surname>
<given-names>M. J.</given-names>
</name>
<name><surname>Segev</surname>
<given-names>R.</given-names>
</name>
<name><surname>Bialek</surname>
<given-names>W.</given-names>
</name>
</person-group>
(<year>2006</year>
). <article-title>Weak pairwise correlations imply strongly correlated network states in a neural population</article-title>
. <source>Nature</source>
<volume>440</volume>
, <fpage>1007</fpage>
–<lpage>1012</lpage>
<pub-id pub-id-type="doi">10.1038/nature04701</pub-id>
<pub-id pub-id-type="pmid">16625187</pub-id>
</mixed-citation>
</ref>
<ref id="B102"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Schwarz</surname>
<given-names>C.</given-names>
</name>
<name><surname>Hentschke</surname>
<given-names>H.</given-names>
</name>
<name><surname>Butovas</surname>
<given-names>S.</given-names>
</name>
<name><surname>Haiss</surname>
<given-names>F.</given-names>
</name>
<name><surname>Stüttgen</surname>
<given-names>M. C.</given-names>
</name>
<name><surname>Gerdjikov</surname>
<given-names>T. V.</given-names>
</name>
<name><surname>Bergner</surname>
<given-names>C. G.</given-names>
</name>
<name><surname>Waiblinger</surname>
<given-names>C.</given-names>
</name>
</person-group>
(<year>2010</year>
). <article-title>The head-fixed behaving rat: procedures and pitfalls</article-title>
. <source>Somatosens. Mot. Res.</source>
<volume>27</volume>
, <fpage>131</fpage>
–<lpage>148</lpage>
<pub-id pub-id-type="doi">10.3109/08990220.2010.513111</pub-id>
<pub-id pub-id-type="pmid">20954892</pub-id>
</mixed-citation>
</ref>
<ref id="B103"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Shadlen</surname>
<given-names>M. N.</given-names>
</name>
<name><surname>Britten</surname>
<given-names>K. H.</given-names>
</name>
<name><surname>Newsome</surname>
<given-names>W. T.</given-names>
</name>
<name><surname>Movshon</surname>
<given-names>J. A.</given-names>
</name>
</person-group>
(<year>1996</year>
). <article-title>A computational analysis of the relationship between neuronal and behavioral responses to visual motion</article-title>
. <source>J. Neurosci.</source>
<volume>16</volume>
, <fpage>1486</fpage>
–<lpage>1510</lpage>
<pub-id pub-id-type="pmid">8778300</pub-id>
</mixed-citation>
</ref>
<ref id="B104"><mixed-citation publication-type="book"><person-group person-group-type="author"><name><surname>Sherrington</surname>
<given-names>C.</given-names>
</name>
</person-group>
(<year>1940</year>
). <source>Man on His Nature</source>
. <publisher-loc>Cambridge</publisher-loc>
: <publisher-name>Cambridge University Press</publisher-name>
</mixed-citation>
</ref>
<ref id="B105"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Shipley</surname>
<given-names>E. F.</given-names>
</name>
</person-group>
(<year>1960</year>
). <article-title>A model for detection and recognition with signal uncertainty</article-title>
. <source>Psychometrika</source>
<volume>25</volume>
, <fpage>273</fpage>
–<lpage>289</lpage>
<pub-id pub-id-type="doi">10.1007/BF02289731</pub-id>
</mixed-citation>
</ref>
<ref id="B106"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Shlens</surname>
<given-names>J.</given-names>
</name>
<name><surname>Field</surname>
<given-names>G. D.</given-names>
</name>
<name><surname>Gauthier</surname>
<given-names>J. L.</given-names>
</name>
<name><surname>Greschner</surname>
<given-names>M.</given-names>
</name>
<name><surname>Sher</surname>
<given-names>A.</given-names>
</name>
<name><surname>Litke</surname>
<given-names>A. M.</given-names>
</name>
<name><surname>Chichilnisky</surname>
<given-names>E. J.</given-names>
</name>
</person-group>
(<year>2009</year>
). <article-title>The structure of large-scale synchronized firing in primate retina</article-title>
. <source>J. Neurosci.</source>
<volume>29</volume>
, <fpage>5022</fpage>
–<lpage>5031</lpage>
<pub-id pub-id-type="doi">10.1523/JNEUROSCI.5187-08.2009</pub-id>
<pub-id pub-id-type="pmid">19369571</pub-id>
</mixed-citation>
</ref>
<ref id="B107"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Shlens</surname>
<given-names>J.</given-names>
</name>
<name><surname>Field</surname>
<given-names>G. D.</given-names>
</name>
<name><surname>Gauthier</surname>
<given-names>J. L.</given-names>
</name>
<name><surname>Grivich</surname>
<given-names>M. I.</given-names>
</name>
<name><surname>Petrusca</surname>
<given-names>D.</given-names>
</name>
<name><surname>Sher</surname>
<given-names>A.</given-names>
</name>
<name><surname>Litke</surname>
<given-names>A. M.</given-names>
</name>
<name><surname>Chichilnisky</surname>
<given-names>E. J.</given-names>
</name>
</person-group>
(<year>2006</year>
). <article-title>The structure of multi-neuron firing patterns in primate retina</article-title>
. <source>J. Neurosci.</source>
<volume>26</volume>
, <fpage>8254</fpage>
–<lpage>8266</lpage>
<pub-id pub-id-type="doi">10.1523/JNEUROSCI.1282-06.2006</pub-id>
<pub-id pub-id-type="pmid">16899720</pub-id>
</mixed-citation>
</ref>
<ref id="B108"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Smith</surname>
<given-names>P. L.</given-names>
</name>
<name><surname>Ratcliff</surname>
<given-names>R.</given-names>
</name>
</person-group>
(<year>2004</year>
). <article-title>Psychology and neurobiology of simple decisions</article-title>
. <source>Trends Neurosci.</source>
<volume>27</volume>
, <fpage>161</fpage>
–<lpage>168</lpage>
<pub-id pub-id-type="doi">10.1016/j.tins.2004.07.004</pub-id>
<pub-id pub-id-type="pmid">15036882</pub-id>
</mixed-citation>
</ref>
<ref id="B109"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Stewart</surname>
<given-names>N.</given-names>
</name>
<name><surname>Brown</surname>
<given-names>G. D. A.</given-names>
</name>
<name><surname>Chater</surname>
<given-names>N.</given-names>
</name>
</person-group>
(<year>2005</year>
). <article-title>Absolute identification by relative judgment</article-title>
. <source>Psychol. Rev.</source>
<volume>112</volume>
, <fpage>881</fpage>
–<lpage>911</lpage>
<pub-id pub-id-type="doi">10.1037/0033-295X.112.4.881</pub-id>
<pub-id pub-id-type="pmid">16262472</pub-id>
</mixed-citation>
</ref>
<ref id="B110"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Stüttgen</surname>
<given-names>M. C.</given-names>
</name>
</person-group>
(<year>2010</year>
). <article-title>Toward behavioral benchmarks for whisker-related sensory processing</article-title>
. <source>J. Neurosci.</source>
<volume>30</volume>
, <fpage>4827</fpage>
–<lpage>4829</lpage>
<pub-id pub-id-type="doi">10.1523/JNEUROSCI.0713-10.2010</pub-id>
<pub-id pub-id-type="pmid">20371801</pub-id>
</mixed-citation>
</ref>
<ref id="B111"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Stüttgen</surname>
<given-names>M. C.</given-names>
</name>
<name><surname>Rüter</surname>
<given-names>J.</given-names>
</name>
<name><surname>Schwarz</surname>
<given-names>C.</given-names>
</name>
</person-group>
(<year>2006</year>
). <article-title>Two psychophysical channels of whisker deflection in rats align with two neuronal classes of primary afferents</article-title>
. <source>J. Neurosci.</source>
<volume>26</volume>
, <fpage>7933</fpage>
–<lpage>7941</lpage>
<pub-id pub-id-type="doi">10.1523/JNEUROSCI.1864-06.2006</pub-id>
<pub-id pub-id-type="pmid">16870738</pub-id>
</mixed-citation>
</ref>
<ref id="B112"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Stüttgen</surname>
<given-names>M. C.</given-names>
</name>
<name><surname>Schwarz</surname>
<given-names>C.</given-names>
</name>
</person-group>
(<year>2008</year>
). <article-title>Psychophysical and neurometric detection performance under stimulus uncertainty</article-title>
. <source>Nat. Neurosci.</source>
<volume>11</volume>
, <fpage>1091</fpage>
–<lpage>1099</lpage>
<pub-id pub-id-type="doi">10.1038/nn.2162</pub-id>
<pub-id pub-id-type="pmid">19160508</pub-id>
</mixed-citation>
</ref>
<ref id="B113"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Stüttgen</surname>
<given-names>M. C.</given-names>
</name>
<name><surname>Schwarz</surname>
<given-names>C.</given-names>
</name>
</person-group>
(<year>2010</year>
). <article-title>Integration of vibrotactile signals for whisker-related perception in rats is governed by short time constants: comparison of neurometric and psychometric detection performance</article-title>
. <source>J. Neurosci.</source>
<volume>30</volume>
, <fpage>2060</fpage>
–<lpage>2069</lpage>
<pub-id pub-id-type="doi">10.1523/JNEUROSCI.0713-10.2010</pub-id>
<pub-id pub-id-type="pmid">20147534</pub-id>
</mixed-citation>
</ref>
<ref id="B114"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Stüttgen</surname>
<given-names>M. C.</given-names>
</name>
<name><surname>Yildiz</surname>
<given-names>A.</given-names>
</name>
<name><surname>Güntürkün</surname>
<given-names>O.</given-names>
</name>
</person-group>
(<year>2011</year>
). <article-title>Adaptive criterion setting in perceptual decision-making</article-title>
. <source>J. Exp. Anal. Behav.</source>
<volume>96</volume>
, <fpage>155</fpage>
–<lpage>176</lpage>
<pub-id pub-id-type="pmid">21909162</pub-id>
</mixed-citation>
</ref>
<ref id="B115"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Swets</surname>
<given-names>J. A.</given-names>
</name>
</person-group>
(<year>1959</year>
). <article-title>Indices of signal detectability obtained with various psychophysical procedures</article-title>
. <source>J. Acoust. Soc. Am.</source>
<volume>31</volume>
, <fpage>511</fpage>
–<lpage>513</lpage>
<pub-id pub-id-type="doi">10.1121/1.1907744</pub-id>
</mixed-citation>
</ref>
<ref id="B116"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Swets</surname>
<given-names>J. A.</given-names>
</name>
</person-group>
(<year>1961a</year>
). <article-title>Detection theory and psychophysics: a review</article-title>
. <source>Psychometrika</source>
<volume>26</volume>
, <fpage>49</fpage>
–<lpage>63</lpage>
<pub-id pub-id-type="doi">10.1007/BF02289684</pub-id>
<pub-id pub-id-type="pmid">13774293</pub-id>
</mixed-citation>
</ref>
<ref id="B117"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Swets</surname>
<given-names>J. A.</given-names>
</name>
</person-group>
(<year>1961b</year>
). <article-title>Is there a sensory threshold?</article-title>
<source>Science</source>
<volume>134</volume>
, <fpage>168</fpage>
–<lpage>177</lpage>
<pub-id pub-id-type="doi">10.1126/science.134.3473.168</pub-id>
<pub-id pub-id-type="pmid">13774294</pub-id>
</mixed-citation>
</ref>
<ref id="B118"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Swets</surname>
<given-names>J. A.</given-names>
</name>
</person-group>
(<year>1973</year>
). <article-title>The relative operating characteristic in psychology: a technique for isolating effects of response bias finds wide use in the study of perception and cognition</article-title>
. <source>Science</source>
<volume>182</volume>
, <fpage>990</fpage>
–<lpage>1000</lpage>
<pub-id pub-id-type="doi">10.1126/science.182.4116.990</pub-id>
<pub-id pub-id-type="pmid">17833780</pub-id>
</mixed-citation>
</ref>
<ref id="B119"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Swets</surname>
<given-names>J. A.</given-names>
</name>
<name><surname>Tanner</surname>
<given-names>W. P.</given-names>
</name>
<name><surname>Birdsall</surname>
<given-names>T. G.</given-names>
</name>
</person-group>
(<year>1961</year>
). <article-title>Decision-processes in perception</article-title>
. <source>Psychol. Rev.</source>
<volume>68</volume>
, <fpage>301</fpage>
–<lpage>340</lpage>
<pub-id pub-id-type="doi">10.1037/h0040547</pub-id>
<pub-id pub-id-type="pmid">13774292</pub-id>
</mixed-citation>
</ref>
<ref id="B120"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Tanner</surname>
<given-names>W. P.</given-names>
</name>
</person-group>
(<year>1961</year>
). <article-title>Physiological implications of psychophysical data</article-title>
. <source>Ann. N. Y. Acad. Sci.</source>
<volume>89</volume>
, <fpage>752</fpage>
–<lpage>765</lpage>
<pub-id pub-id-type="doi">10.1111/j.1749-6632.1961.tb20176.x</pub-id>
<pub-id pub-id-type="pmid">13775211</pub-id>
</mixed-citation>
</ref>
<ref id="B121"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Tanner</surname>
<given-names>W. P.</given-names>
</name>
<name><surname>Swets</surname>
<given-names>J. A.</given-names>
</name>
</person-group>
(<year>1954</year>
). <article-title>A decision-making theory of visual detection</article-title>
. <source>Psychol. Rev.</source>
<volume>61</volume>
, <fpage>401</fpage>
–<lpage>409</lpage>
<pub-id pub-id-type="doi">10.1037/h0058700</pub-id>
<pub-id pub-id-type="pmid">13215690</pub-id>
</mixed-citation>
</ref>
<ref id="B122"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Teichert</surname>
<given-names>T.</given-names>
</name>
<name><surname>Ferrara</surname>
<given-names>V. P.</given-names>
</name>
</person-group>
(<year>2010</year>
). <article-title>Suboptimal integration of reward magnitude and prior reward likelihood in categorical decisions by monkeys</article-title>
. <source>Front. Neurosci.</source>
<volume>4</volume>
:<fpage>186</fpage>
<pub-id pub-id-type="doi">10.3389/fnins.2010.00186</pub-id>
<pub-id pub-id-type="pmid">21151367</pub-id>
</mixed-citation>
</ref>
<ref id="B123"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Tolhurst</surname>
<given-names>D. J.</given-names>
</name>
<name><surname>Movshon</surname>
<given-names>J. A.</given-names>
</name>
<name><surname>Dean</surname>
<given-names>A. F.</given-names>
</name>
</person-group>
(<year>1983</year>
). <article-title>The statistical reliability of signals in single neurons in cat and monkey visual cortex</article-title>
. <source>Vision Res.</source>
<volume>23</volume>
, <fpage>775</fpage>
–<lpage>785</lpage>
<pub-id pub-id-type="doi">10.1016/0042-6989(83)90200-6</pub-id>
<pub-id pub-id-type="pmid">6623937</pub-id>
</mixed-citation>
</ref>
<ref id="B124"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Treisman</surname>
<given-names>M.</given-names>
</name>
<name><surname>Williams</surname>
<given-names>T. C.</given-names>
</name>
</person-group>
(<year>1984</year>
). <article-title>A theory of criterion setting with an application to sequential dependencies</article-title>
. <source>Psychol. Rev.</source>
<volume>91</volume>
, <fpage>68</fpage>
–<lpage>111</lpage>
<pub-id pub-id-type="doi">10.1037/0033-295X.91.1.68</pub-id>
</mixed-citation>
</ref>
<ref id="B125"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Treue</surname>
<given-names>S.</given-names>
</name>
<name><surname>Martinez Trujillo</surname>
<given-names>J. C.</given-names>
</name>
</person-group>
(<year>1999</year>
). <article-title>Feature-based attention influences motion processing gain in macaque visual cortex</article-title>
. <source>Nature</source>
<volume>399</volume>
, <fpage>575</fpage>
–<lpage>579</lpage>
<pub-id pub-id-type="doi">10.1038/21176</pub-id>
<pub-id pub-id-type="pmid">10376597</pub-id>
</mixed-citation>
</ref>
<ref id="B126"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Uka</surname>
<given-names>T.</given-names>
</name>
<name><surname>DeAngelis</surname>
<given-names>G. C.</given-names>
</name>
</person-group>
(<year>2003</year>
). <article-title>Contribution of middle temporal area to coarse depth discrimination: comparison of neuronal and psychophysical sensitivity</article-title>
. <source>J. Neurosci.</source>
<volume>23</volume>
, <fpage>3515</fpage>
–<lpage>3530</lpage>
<pub-id pub-id-type="pmid">12716961</pub-id>
</mixed-citation>
</ref>
<ref id="B127"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Ulrich</surname>
<given-names>R.</given-names>
</name>
</person-group>
(<year>2010</year>
). <article-title>DLs in reminder and 2AFC tasks: data and models</article-title>
. <source>Atten. Percept. Psychophys.</source>
<volume>72</volume>
, <fpage>1179</fpage>
–<lpage>1198</lpage>
<pub-id pub-id-type="doi">10.3758/APP.72.4.1179</pub-id>
<pub-id pub-id-type="pmid">20436209</pub-id>
</mixed-citation>
</ref>
<ref id="B128"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Ulrich</surname>
<given-names>R.</given-names>
</name>
<name><surname>Vorberg</surname>
<given-names>D.</given-names>
</name>
</person-group>
(<year>2009</year>
). <article-title>Estimating the difference limen in 2AFC tasks: pitfalls and improved estimators</article-title>
. <source>Atten. Percept. Psychophys.</source>
<volume>71</volume>
, <fpage>1219</fpage>
–<lpage>1227</lpage>
<pub-id pub-id-type="doi">10.3758/APP.71.6.1219</pub-id>
<pub-id pub-id-type="pmid">19633337</pub-id>
</mixed-citation>
</ref>
<ref id="B129"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Vallbo</surname>
<given-names>A. B.</given-names>
</name>
<name><surname>Olsson</surname>
<given-names>K. A.</given-names>
</name>
<name><surname>Westberg</surname>
<given-names>K. G.</given-names>
</name>
<name><surname>Clark</surname>
<given-names>F. J.</given-names>
</name>
</person-group>
(<year>1984</year>
). <article-title>Microstimulation of single tactile afferents from the human hand. Sensory attributes related to unit type and properties of receptive fields</article-title>
. <source>Brain</source>
<volume>107</volume>
(<issue>Pt 3</issue>
), <fpage>727</fpage>
–<lpage>749</lpage>
<pub-id pub-id-type="doi">10.1093/brain/107.3.727</pub-id>
<pub-id pub-id-type="pmid">6478176</pub-id>
</mixed-citation>
</ref>
<ref id="B130"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Verplanck</surname>
<given-names>W. S.</given-names>
</name>
<name><surname>Collier</surname>
<given-names>G. H.</given-names>
</name>
<name><surname>Cotton</surname>
<given-names>J. W.</given-names>
</name>
</person-group>
(<year>1952</year>
). <article-title>Nonindependence of successive responses in measurements of the visual threshold</article-title>
. <source>J. Exp. Psychol.</source>
<volume>44</volume>
, <fpage>273</fpage>
–<lpage>282</lpage>
<pub-id pub-id-type="doi">10.1037/h0054948</pub-id>
<pub-id pub-id-type="pmid">13000069</pub-id>
</mixed-citation>
</ref>
<ref id="B131"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Vogels</surname>
<given-names>R.</given-names>
</name>
<name><surname>Orban</surname>
<given-names>G. A.</given-names>
</name>
</person-group>
(<year>1990</year>
). <article-title>How well do response changes of striate neurons signal differences in orientation: a study in the discriminating monkey</article-title>
. <source>J. Neurosci.</source>
<volume>10</volume>
, <fpage>3543</fpage>
–<lpage>3558</lpage>
<pub-id pub-id-type="pmid">2230944</pub-id>
</mixed-citation>
</ref>
<ref id="B132"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Voigt</surname>
<given-names>B. C.</given-names>
</name>
<name><surname>Brecht</surname>
<given-names>M.</given-names>
</name>
<name><surname>Houweling</surname>
<given-names>A. R.</given-names>
</name>
</person-group>
(<year>2008</year>
). <article-title>Behavioral detectability of single-cell stimulation in the ventral posterior medial nucleus of the thalamus</article-title>
. <source>J. Neurosci.</source>
<volume>28</volume>
, <fpage>12362</fpage>
–<lpage>12367</lpage>
<pub-id pub-id-type="doi">10.1523/JNEUROSCI.3046-08.2008</pub-id>
<pub-id pub-id-type="pmid">19020029</pub-id>
</mixed-citation>
</ref>
<ref id="B133"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>von Heimendahl</surname>
<given-names>M.</given-names>
</name>
<name><surname>Itskov</surname>
<given-names>P. M.</given-names>
</name>
<name><surname>Arabzadeh</surname>
<given-names>E.</given-names>
</name>
<name><surname>Diamond</surname>
<given-names>M. E.</given-names>
</name>
</person-group>
(<year>2007</year>
). <article-title>Neuronal activity in rat barrel cortex underlying texture discrimination</article-title>
. <source>PLoS Biol.</source>
<volume>5</volume>
, <fpage>e305</fpage>
<pub-id pub-id-type="doi">10.1371/journal.pbio.0050305</pub-id>
<pub-id pub-id-type="pmid">18001152</pub-id>
</mixed-citation>
</ref>
<ref id="B134"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Wichmann</surname>
<given-names>F. A.</given-names>
</name>
<name><surname>Hill</surname>
<given-names>N. J.</given-names>
</name>
</person-group>
(<year>2001a</year>
). <article-title>The psychometric function: I. Fitting, sampling, and goodness of fit</article-title>
. <source>Percept. Psychophys.</source>
<volume>63</volume>
, <fpage>1293</fpage>
–<lpage>1313</lpage>
<pub-id pub-id-type="doi">10.3758/BF03194545</pub-id>
<pub-id pub-id-type="pmid">11800458</pub-id>
</mixed-citation>
</ref>
<ref id="B135"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Wichmann</surname>
<given-names>F. A.</given-names>
</name>
<name><surname>Hill</surname>
<given-names>N. J.</given-names>
</name>
</person-group>
(<year>2001b</year>
). <article-title>The psychometric function: II. Bootstrap-based confidence intervals and sampling</article-title>
. <source>Percept. Psychophys.</source>
<volume>63</volume>
, <fpage>1314</fpage>
–<lpage>1329</lpage>
<pub-id pub-id-type="doi">10.3758/BF03194545</pub-id>
<pub-id pub-id-type="pmid">11800459</pub-id>
</mixed-citation>
</ref>
<ref id="B136"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Wolfe</surname>
<given-names>J. M.</given-names>
</name>
<name><surname>Van Wert</surname>
<given-names>M. J.</given-names>
</name>
</person-group>
(<year>2010</year>
). <article-title>Varying target prevalence reveals two dissociable decision criteria in visual search</article-title>
. <source>Curr. Biol.</source>
<volume>20</volume>
, <fpage>121</fpage>
–<lpage>124</lpage>
<pub-id pub-id-type="doi">10.1016/j.cub.2010.02.016</pub-id>
<pub-id pub-id-type="pmid">20079642</pub-id>
</mixed-citation>
</ref>
<ref id="B137"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Yeshurun</surname>
<given-names>Y.</given-names>
</name>
<name><surname>Carrasco</surname>
<given-names>M.</given-names>
</name>
<name><surname>Maloney</surname>
<given-names>L. T.</given-names>
</name>
</person-group>
(<year>2008</year>
). <article-title>Bias and sensitivity in two-interval forced choice procedures: tests of the difference model</article-title>
. <source>Vision Res.</source>
<volume>48</volume>
, <fpage>1837</fpage>
–<lpage>1851</lpage>
<pub-id pub-id-type="doi">10.1016/j.visres.2007.10.015</pub-id>
<pub-id pub-id-type="pmid">18585750</pub-id>
</mixed-citation>
</ref>
<ref id="B138"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Yizhar</surname>
<given-names>O.</given-names>
</name>
<name><surname>Fenno</surname>
<given-names>L. E.</given-names>
</name>
<name><surname>Davidson</surname>
<given-names>T. J.</given-names>
</name>
<name><surname>Mogri</surname>
<given-names>M.</given-names>
</name>
<name><surname>Deisseroth</surname>
<given-names>K.</given-names>
</name>
</person-group>
(<year>2011</year>
). <article-title>Optogenetics in neural systems</article-title>
. <source>Neuron</source>
<volume>71</volume>
, <fpage>9</fpage>
–<lpage>34</lpage>
<pub-id pub-id-type="doi">10.1016/j.neuron.2011.06.004</pub-id>
<pub-id pub-id-type="pmid">21745635</pub-id>
</mixed-citation>
</ref>
<ref id="B139"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Zohary</surname>
<given-names>E.</given-names>
</name>
<name><surname>Shadlen</surname>
<given-names>M. N.</given-names>
</name>
<name><surname>Newsome</surname>
<given-names>W. T.</given-names>
</name>
</person-group>
(<year>1994</year>
). <article-title>Correlated neuronal discharge rate and its implications for psychophysical performance</article-title>
. <source>Nature</source>
<volume>370</volume>
, <fpage>140</fpage>
–<lpage>143</lpage>
<pub-id pub-id-type="doi">10.1038/370140a0</pub-id>
<pub-id pub-id-type="pmid">8022482</pub-id>
</mixed-citation>
</ref>
</ref-list>
</back>
</pmc>
<affiliations><list><country><li>Allemagne</li>
</country>
</list>
<tree><country name="Allemagne"><noRegion><name sortKey="Stuttgen, Maik C" sort="Stuttgen, Maik C" uniqKey="Stuttgen M" first="Maik C." last="Stüttgen">Maik C. Stüttgen</name>
</noRegion>
<name sortKey="J Kel, Frank" sort="J Kel, Frank" uniqKey="J Kel F" first="Frank" last="J Kel">Frank J Kel</name>
<name sortKey="Schwarz, Cornelius" sort="Schwarz, Cornelius" uniqKey="Schwarz C" first="Cornelius" last="Schwarz">Cornelius Schwarz</name>
<name sortKey="Schwarz, Cornelius" sort="Schwarz, Cornelius" uniqKey="Schwarz C" first="Cornelius" last="Schwarz">Cornelius Schwarz</name>
</country>
</tree>
</affiliations>
</record>
Pour manipuler ce document sous Unix (Dilib)
EXPLOR_STEP=$WICRI_ROOT/Ticri/CIDE/explor/HapticV1/Data/Pmc/Checkpoint
HfdSelect -h $EXPLOR_STEP/biblio.hfd -nk 001A91 | SxmlIndent | more
Ou
HfdSelect -h $EXPLOR_AREA/Data/Pmc/Checkpoint/biblio.hfd -nk 001A91 | SxmlIndent | more
Pour mettre un lien sur cette page dans le réseau Wicri
{{Explor lien |wiki= Ticri/CIDE |area= HapticV1 |flux= Pmc |étape= Checkpoint |type= RBID |clé= PMC:3212738 |texte= Mapping Spikes to Sensations }}
Pour générer des pages wiki
HfdIndexSelect -h $EXPLOR_AREA/Data/Pmc/Checkpoint/RBID.i -Sk "pubmed:22084627" \ | HfdSelect -Kh $EXPLOR_AREA/Data/Pmc/Checkpoint/biblio.hfd \ | NlmPubMed2Wicri -a HapticV1
![]() | This area was generated with Dilib version V0.6.23. | ![]() |