Confidence measurement in the light of signal detection theory
Identifieur interne : 003B49 ( Main/Merge ); précédent : 003B48; suivant : 003B50Confidence measurement in the light of signal detection theory
Auteurs : Sébastien Massoni [Australie] ; Thibault Gajdos [France] ; Jean-Christophe Vergnaud [France]Source :
- Frontiers in Psychology [ 1664-1078 ] ; 2014.
Abstract
We compare three alternative methods for eliciting retrospective confidence in the context of a simple perceptual task: the Simple Confidence Rating (a direct report on a numerical scale), the Quadratic Scoring Rule (a post-wagering procedure), and the Matching Probability (MP; a generalization of the no-loss gambling method). We systematically compare the results obtained with these three rules to the theoretical confidence levels that can be inferred from performance in the perceptual task using Signal Detection Theory (SDT). We find that the MP provides better results in that respect. We conclude that MP is particularly well suited for studies of confidence that use SDT as a theoretical framework.
Url:
DOI: 10.3389/fpsyg.2014.01455
PubMed: 25566135
PubMed Central: 4263084
Links toward previous steps (curation, corpus...)
- to stream Pmc, to step Corpus: 002523
- to stream Pmc, to step Curation: 002373
- to stream Pmc, to step Checkpoint: 001688
- to stream PubMed, to step Corpus: 003236
- to stream PubMed, to step Curation: 003126
- to stream PubMed, to step Checkpoint: 003126
- to stream Ncbi, to step Merge: 002148
- to stream Ncbi, to step Curation: 002148
- to stream Ncbi, to step Checkpoint: 002148
Links to Exploration step
PMC:4263084Le document en format XML
<record><TEI><teiHeader><fileDesc><titleStmt><title xml:lang="en">Confidence measurement in the light of signal detection theory</title><author><name sortKey="Massoni, Sebastien" sort="Massoni, Sebastien" uniqKey="Massoni S" first="Sébastien" last="Massoni">Sébastien Massoni</name><affiliation wicri:level="1"><nlm:aff id="aff1"><institution>Queensland Behavioural Economics Group – School of Economics and Finance, Queensland University of Technology</institution><country>Brisbane, QLD, Australia</country></nlm:aff><country xml:lang="fr">Australie</country><wicri:regionArea>Department of Medical Microbiology and Virology, National Health Laboratory Service/University of the Free State, Bloemfontein 9301</wicri:regionArea><wicri:noRegion>Bloemfontein 9301</wicri:noRegion></affiliation></author><author><name sortKey="Gajdos, Thibault" sort="Gajdos, Thibault" uniqKey="Gajdos T" first="Thibault" last="Gajdos">Thibault Gajdos</name><affiliation wicri:level="1"><nlm:aff id="aff2"><institution>Groupement de Recherche en Economie Quantitative d’Aix-Marseille, École des Hautes Études en Sciences Sociales, Aix Marseille University</institution><country>Marseille, France</country></nlm:aff><country xml:lang="fr">France</country><wicri:regionArea>Department of Medical Microbiology and Virology, National Health Laboratory Service/University of the Free State, Bloemfontein 9301</wicri:regionArea><wicri:noRegion>Bloemfontein 9301</wicri:noRegion><wicri:noRegion>Bloemfontein 9301</wicri:noRegion></affiliation><affiliation wicri:level="1"><nlm:aff id="aff3"><institution>Centre National de la Recherche Scientifique</institution><country>France</country></nlm:aff><country xml:lang="fr">France</country><wicri:regionArea># see nlm:aff country strict</wicri:regionArea></affiliation></author><author><name sortKey="Vergnaud, Jean Christophe" sort="Vergnaud, Jean Christophe" uniqKey="Vergnaud J" first="Jean-Christophe" last="Vergnaud">Jean-Christophe Vergnaud</name><affiliation wicri:level="1"><nlm:aff id="aff3"><institution>Centre National de la Recherche Scientifique</institution><country>France</country></nlm:aff><country xml:lang="fr">France</country><wicri:regionArea># see nlm:aff country strict</wicri:regionArea></affiliation><affiliation wicri:level="1"><nlm:aff id="aff4"><institution>Centre d’Economie de la Sorbonne, University of Paris 1</institution><country>Paris, France</country></nlm:aff><country xml:lang="fr">France</country><wicri:regionArea>Department of Medical Microbiology and Virology, National Health Laboratory Service/University of the Free State, Bloemfontein 9301</wicri:regionArea><wicri:noRegion>Bloemfontein 9301</wicri:noRegion><wicri:noRegion>Bloemfontein 9301</wicri:noRegion></affiliation></author></titleStmt><publicationStmt><idno type="wicri:source">PMC</idno><idno type="pmid">25566135</idno><idno type="pmc">4263084</idno><idno type="url">http://www.ncbi.nlm.nih.gov/pmc/articles/PMC4263084</idno><idno type="RBID">PMC:4263084</idno><idno type="doi">10.3389/fpsyg.2014.01455</idno><date when="2014">2014</date><idno type="wicri:Area/Pmc/Corpus">002523</idno><idno type="wicri:explorRef" wicri:stream="Pmc" wicri:step="Corpus" wicri:corpus="PMC">002523</idno><idno type="wicri:Area/Pmc/Curation">002373</idno><idno type="wicri:explorRef" wicri:stream="Pmc" wicri:step="Curation">002373</idno><idno type="wicri:Area/Pmc/Checkpoint">001688</idno><idno type="wicri:explorRef" wicri:stream="Pmc" wicri:step="Checkpoint">001688</idno><idno type="wicri:source">PubMed</idno><idno type="wicri:Area/PubMed/Corpus">003236</idno><idno type="wicri:explorRef" wicri:stream="PubMed" wicri:step="Corpus" wicri:corpus="PubMed">003236</idno><idno type="wicri:Area/PubMed/Curation">003126</idno><idno type="wicri:explorRef" wicri:stream="PubMed" wicri:step="Curation">003126</idno><idno type="wicri:Area/PubMed/Checkpoint">003126</idno><idno type="wicri:explorRef" wicri:stream="Checkpoint" wicri:step="PubMed">003126</idno><idno type="wicri:Area/Ncbi/Merge">002148</idno><idno type="wicri:Area/Ncbi/Curation">002148</idno><idno type="wicri:Area/Ncbi/Checkpoint">002148</idno><idno type="wicri:Area/Main/Merge">003B49</idno></publicationStmt><sourceDesc><biblStruct><analytic><title xml:lang="en" level="a" type="main">Confidence measurement in the light of signal detection theory</title><author><name sortKey="Massoni, Sebastien" sort="Massoni, Sebastien" uniqKey="Massoni S" first="Sébastien" last="Massoni">Sébastien Massoni</name><affiliation wicri:level="1"><nlm:aff id="aff1"><institution>Queensland Behavioural Economics Group – School of Economics and Finance, Queensland University of Technology</institution><country>Brisbane, QLD, Australia</country></nlm:aff><country xml:lang="fr">Australie</country><wicri:regionArea>Department of Medical Microbiology and Virology, National Health Laboratory Service/University of the Free State, Bloemfontein 9301</wicri:regionArea><wicri:noRegion>Bloemfontein 9301</wicri:noRegion></affiliation></author><author><name sortKey="Gajdos, Thibault" sort="Gajdos, Thibault" uniqKey="Gajdos T" first="Thibault" last="Gajdos">Thibault Gajdos</name><affiliation wicri:level="1"><nlm:aff id="aff2"><institution>Groupement de Recherche en Economie Quantitative d’Aix-Marseille, École des Hautes Études en Sciences Sociales, Aix Marseille University</institution><country>Marseille, France</country></nlm:aff><country xml:lang="fr">France</country><wicri:regionArea>Department of Medical Microbiology and Virology, National Health Laboratory Service/University of the Free State, Bloemfontein 9301</wicri:regionArea><wicri:noRegion>Bloemfontein 9301</wicri:noRegion><wicri:noRegion>Bloemfontein 9301</wicri:noRegion></affiliation><affiliation wicri:level="1"><nlm:aff id="aff3"><institution>Centre National de la Recherche Scientifique</institution><country>France</country></nlm:aff><country xml:lang="fr">France</country><wicri:regionArea># see nlm:aff country strict</wicri:regionArea></affiliation></author><author><name sortKey="Vergnaud, Jean Christophe" sort="Vergnaud, Jean Christophe" uniqKey="Vergnaud J" first="Jean-Christophe" last="Vergnaud">Jean-Christophe Vergnaud</name><affiliation wicri:level="1"><nlm:aff id="aff3"><institution>Centre National de la Recherche Scientifique</institution><country>France</country></nlm:aff><country xml:lang="fr">France</country><wicri:regionArea># see nlm:aff country strict</wicri:regionArea></affiliation><affiliation wicri:level="1"><nlm:aff id="aff4"><institution>Centre d’Economie de la Sorbonne, University of Paris 1</institution><country>Paris, France</country></nlm:aff><country xml:lang="fr">France</country><wicri:regionArea>Department of Medical Microbiology and Virology, National Health Laboratory Service/University of the Free State, Bloemfontein 9301</wicri:regionArea><wicri:noRegion>Bloemfontein 9301</wicri:noRegion><wicri:noRegion>Bloemfontein 9301</wicri:noRegion></affiliation></author></analytic><series><title level="j">Frontiers in Psychology</title><idno type="eISSN">1664-1078</idno><imprint><date when="2014">2014</date></imprint></series></biblStruct></sourceDesc></fileDesc><profileDesc><textClass></textClass></profileDesc></teiHeader><front><div type="abstract" xml:lang="en"><p>We compare three alternative methods for eliciting retrospective confidence in the context of a simple perceptual task: the Simple Confidence Rating (a direct report on a numerical scale), the Quadratic Scoring Rule (a post-wagering procedure), and the Matching Probability (MP; a generalization of the no-loss gambling method). We systematically compare the results obtained with these three rules to the theoretical confidence levels that can be inferred from performance in the perceptual task using Signal Detection Theory (SDT). We find that the MP provides better results in that respect. We conclude that MP is particularly well suited for studies of confidence that use SDT as a theoretical framework.</p></div></front><back><div1 type="bibliography"><listBibl><biblStruct><analytic><author><name sortKey="Barett, A B" uniqKey="Barett A">A. B. Barett</name></author><author><name sortKey="Dienes, Z" uniqKey="Dienes Z">Z. Dienes</name></author><author><name sortKey="Seth, A K" uniqKey="Seth A">A. K. Seth</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Becker, G M" uniqKey="Becker G">G. M. Becker</name></author><author><name sortKey="Degroot, M H" uniqKey="Degroot M">M. H. DeGroot</name></author><author><name sortKey="Marschak, J" uniqKey="Marschak J">J. Marschak</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Brainard, D H" uniqKey="Brainard D">D. H. Brainard</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Brier, G W" uniqKey="Brier G">G. W. Brier</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Bogacz, R" uniqKey="Bogacz R">R. Bogacz</name></author><author><name sortKey="Brown, E" uniqKey="Brown E">E. Brown</name></author><author><name sortKey="Moehlis, J" uniqKey="Moehlis J">J. Moehlis</name></author><author><name sortKey="Holmes, P" uniqKey="Holmes P">P. Holmes</name></author><author><name sortKey="Cohen, J D" uniqKey="Cohen J">J. D. Cohen</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Clarke, F" uniqKey="Clarke F">F. Clarke</name></author><author><name sortKey="Birdsall, T" uniqKey="Birdsall T">T. Birdsall</name></author><author><name sortKey="Tanner, W" uniqKey="Tanner W">W. Tanner</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Dienes, Z" uniqKey="Dienes Z">Z. Dienes</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Dienes, Z" uniqKey="Dienes Z">Z. Dienes</name></author><author><name sortKey="Seth, A" uniqKey="Seth A">A. Seth</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Dunlosky, J" uniqKey="Dunlosky J">J. Dunlosky</name></author><author><name sortKey="Metcalfe, J" uniqKey="Metcalfe J">J. Metcalfe</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Fleming, S M" uniqKey="Fleming S">S. M. Fleming</name></author><author><name sortKey="Dolan, R J" uniqKey="Dolan R">R. J. Dolan</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Fleming, S M" uniqKey="Fleming S">S. M. Fleming</name></author><author><name sortKey="Dolan, R J" uniqKey="Dolan R">R. J. Dolan</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Fleming, S M" uniqKey="Fleming S">S. M. Fleming</name></author><author><name sortKey="Weil, R S" uniqKey="Weil R">R. S. Weil</name></author><author><name sortKey="Nagy, Z" uniqKey="Nagy Z">Z. Nagy</name></author><author><name sortKey="Dolan, R J" uniqKey="Dolan R">R. J. Dolan</name></author><author><name sortKey="Rees, G" uniqKey="Rees G">G. Rees</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Galvin, S" uniqKey="Galvin S">S. Galvin</name></author><author><name sortKey="Podd, J" uniqKey="Podd J">J. Podd</name></author><author><name sortKey="Drga, V" uniqKey="Drga V">V. Drga</name></author><author><name sortKey="Whitmore, J" uniqKey="Whitmore J">J. Whitmore</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Gneiting, T" uniqKey="Gneiting T">T. Gneiting</name></author><author><name sortKey="Raftery, A E" uniqKey="Raftery A">A. E. Raftery</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Green, D A" uniqKey="Green D">D. A. Green</name></author><author><name sortKey="Swets, J A" uniqKey="Swets J">J. A. Swets</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Kanai, R" uniqKey="Kanai R">R. Kanai</name></author><author><name sortKey="Walsh, V" uniqKey="Walsh V">V. Walsh</name></author><author><name sortKey="Tseng, C" uniqKey="Tseng C">C. Tseng</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Kepecs, A" uniqKey="Kepecs A">A. Kepecs</name></author><author><name sortKey="Uchida, N" uniqKey="Uchida N">N. Uchida</name></author><author><name sortKey="Zariwala, H" uniqKey="Zariwala H">H. Zariwala</name></author><author><name sortKey="Mainen, Z" uniqKey="Mainen Z">Z. Mainen</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Kiani, R" uniqKey="Kiani R">R. Kiani</name></author><author><name sortKey="Shalden, M" uniqKey="Shalden M">M. Shalden</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Levitt, H" uniqKey="Levitt H">H. Levitt</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Maniscalco, B" uniqKey="Maniscalco B">B. Maniscalco</name></author><author><name sortKey="Lau, H" uniqKey="Lau H">H. Lau</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Massoni, S" uniqKey="Massoni S">S. Massoni</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Middlebrooks, P G" uniqKey="Middlebrooks P">P. G. Middlebrooks</name></author><author><name sortKey="Sommer, M A" uniqKey="Sommer M">M. A. Sommer</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Nieder, A" uniqKey="Nieder A">A. Nieder</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Nieder, A" uniqKey="Nieder A">A. Nieder</name></author><author><name sortKey="Miller, E K" uniqKey="Miller E">E. K. Miller</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Nyarko, Y" uniqKey="Nyarko Y">Y. Nyarko</name></author><author><name sortKey="Schotter, A" uniqKey="Schotter A">A. Schotter</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Offerman, T" uniqKey="Offerman T">T. Offerman</name></author><author><name sortKey="Sonnemans, J" uniqKey="Sonnemans J">J. Sonnemans</name></author><author><name sortKey="Van De Kuilen, G" uniqKey="Van De Kuilen G">G. Van de Kuilen</name></author><author><name sortKey="Wakker, P P" uniqKey="Wakker P">P. P. Wakker</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Overgaard, M" uniqKey="Overgaard M">M. Overgaard</name></author><author><name sortKey="Sandberg, K" uniqKey="Sandberg K">K. Sandberg</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Palfrey, T" uniqKey="Palfrey T">T. Palfrey</name></author><author><name sortKey="Wang, S" uniqKey="Wang S">S. Wang</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Palmer, T N" uniqKey="Palmer T">T. N. Palmer</name></author><author><name sortKey="Hagedorn, R" uniqKey="Hagedorn R">R. Hagedorn</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Persaud, N" uniqKey="Persaud N">N. Persaud</name></author><author><name sortKey="Mcleod, P" uniqKey="Mcleod P">P. McLeod</name></author><author><name sortKey="Cowey, A" uniqKey="Cowey A">A. Cowey</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Piazza, M" uniqKey="Piazza M">M. Piazza</name></author><author><name sortKey="Izard, V" uniqKey="Izard V">V. Izard</name></author><author><name sortKey="Pinel, P" uniqKey="Pinel P">P. Pinel</name></author><author><name sortKey="Le Bihan, D" uniqKey="Le Bihan D">D. Le Bihan</name></author><author><name sortKey="Dehaene, S" uniqKey="Dehaene S">S. Dehaene</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Pica, P" uniqKey="Pica P">P. Pica</name></author><author><name sortKey="Lemer, C" uniqKey="Lemer C">C. Lemer</name></author><author><name sortKey="Izard, V" uniqKey="Izard V">V. Izard</name></author><author><name sortKey="Dehaene, S" uniqKey="Dehaene S">S. Dehaene</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Pleskac, T J" uniqKey="Pleskac T">T. J. Pleskac</name></author><author><name sortKey="Busemeyer, J R" uniqKey="Busemeyer J">J. R. Busemeyer</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Pollack, I" uniqKey="Pollack I">I. Pollack</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Ratcliff, R" uniqKey="Ratcliff R">R. Ratcliff</name></author><author><name sortKey="Mckoon, G" uniqKey="Mckoon G">G. McKoon</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Ratcliff, R" uniqKey="Ratcliff R">R. Ratcliff</name></author><author><name sortKey="Starns, J J" uniqKey="Starns J">J. J. Starns</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Rounis, E" uniqKey="Rounis E">E. Rounis</name></author><author><name sortKey="Maniscalco, B" uniqKey="Maniscalco B">B. Maniscalco</name></author><author><name sortKey="Rothwell, J" uniqKey="Rothwell J">J. Rothwell</name></author><author><name sortKey="Passingham, R" uniqKey="Passingham R">R. Passingham</name></author><author><name sortKey="Lau, H" uniqKey="Lau H">H. Lau</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Sandberg, K" uniqKey="Sandberg K">K. Sandberg</name></author><author><name sortKey="Timmermans, B" uniqKey="Timmermans B">B. Timmermans</name></author><author><name sortKey="Overgaard, M" uniqKey="Overgaard M">M. Overgaard</name></author><author><name sortKey="Cleeremans, A" uniqKey="Cleeremans A">A. Cleeremans</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Schurger, A" uniqKey="Schurger A">A. Schurger</name></author><author><name sortKey="Sher, S" uniqKey="Sher S">S. Sher</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Scott, R B" uniqKey="Scott R">R. B. Scott</name></author><author><name sortKey="Dienes, Z" uniqKey="Dienes Z">Z. Dienes</name></author><author><name sortKey="Barrett, A B" uniqKey="Barrett A">A. B. Barrett</name></author><author><name sortKey="Bor, D" uniqKey="Bor D">D. Bor</name></author><author><name sortKey="Seth, A K" uniqKey="Seth A">A. K. Seth</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Smith, J D" uniqKey="Smith J">J. D. Smith</name></author><author><name sortKey="Shields, W E" uniqKey="Shields W">W. E. Shields</name></author><author><name sortKey="Washburn, D A" uniqKey="Washburn D">D. A. Washburn</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Wickens, T D" uniqKey="Wickens T">T. D. Wickens</name></author></analytic></biblStruct><biblStruct><analytic><author><name sortKey="Zar, J H" uniqKey="Zar J">J. H. Zar</name></author></analytic></biblStruct></listBibl></div1></back></TEI></record>Pour manipuler ce document sous Unix (Dilib)
EXPLOR_STEP=$WICRI_ROOT/Wicri/Asie/explor/AustralieFrV1/Data/Main/Merge
HfdSelect -h $EXPLOR_STEP/biblio.hfd -nk 003B49 | SxmlIndent | more
Ou
HfdSelect -h $EXPLOR_AREA/Data/Main/Merge/biblio.hfd -nk 003B49 | SxmlIndent | more
Pour mettre un lien sur cette page dans le réseau Wicri
{{Explor lien
|wiki= Wicri/Asie
|area= AustralieFrV1
|flux= Main
|étape= Merge
|type= RBID
|clé= PMC:4263084
|texte= Confidence measurement in the light of signal detection theory
}}
Pour générer des pages wiki
HfdIndexSelect -h $EXPLOR_AREA/Data/Main/Merge/RBID.i -Sk "pubmed:25566135" \
| HfdSelect -Kh $EXPLOR_AREA/Data/Main/Merge/biblio.hfd \
| NlmPubMed2Wicri -a AustralieFrV1
| This area was generated with Dilib version V0.6.33. |  |