Reward Maximization Justifies the Transition from Sensory Selection at Childhood to Sensory Integration at Adulthood
Identifieur interne : 003163 ( Ncbi/Checkpoint ); précédent : 003162; suivant : 003164Reward Maximization Justifies the Transition from Sensory Selection at Childhood to Sensory Integration at Adulthood
Auteurs : Pedram Daee [Iran] ; Maryam S. Mirian [Iran] ; Majid Nili Ahmadabadi [Iran]Source :
- PLoS ONE [ 1932-6203 ] ; 2014.
Abstract
In a multisensory task, human adults integrate information from different sensory modalities -behaviorally in an optimal Bayesian fashion- while children mostly rely on a single sensor modality for decision making. The reason behind this change of behavior over age and the process behind learning the required statistics for optimal integration are still unclear and have not been justified by the conventional Bayesian modeling. We propose an interactive multisensory learning framework without making any prior assumptions about the sensory models. In this framework, learning in every modality and in their joint space is done in parallel using a single-step reinforcement learning method. A simple statistical test on confidence intervals on the mean of reward distributions is used to select the most informative source of information among the individual modalities and the joint space. Analyses of the method and the simulation results on a multimodal localization task show that the learning system autonomously starts with sensory selection and gradually switches to sensory integration. This is because, relying more on modalities -i.e. selection- at early learning steps (childhood) is more rewarding than favoring decisions learned in the joint space since, smaller state-space in modalities results in faster learning in every individual modality. In contrast, after gaining sufficient experiences (adulthood), the quality of learning in the joint space matures while learning in modalities suffers from insufficient accuracy due to perceptual aliasing. It results in tighter confidence interval for the joint space and consequently causes a smooth shift from selection to integration. It suggests that sensory selection and integration are emergent behavior and both are outputs of a single reward maximization process; i.e. the transition is not a preprogrammed phenomenon.
Url:
DOI: 10.1371/journal.pone.0103143
PubMed: 25058591
PubMed Central: 4110011
Affiliations:
Links toward previous steps (curation, corpus...)
- to stream Pmc, to step Corpus: 000338
- to stream Pmc, to step Curation: 000338
- to stream Pmc, to step Checkpoint: 000995
- to stream Ncbi, to step Merge: 003163
- to stream Ncbi, to step Curation: 003163
Links to Exploration step
PMC:4110011Le document en format XML
<record><TEI><teiHeader><fileDesc><titleStmt><title xml:lang="en">Reward Maximization Justifies the Transition from Sensory Selection at Childhood to Sensory Integration at Adulthood</title>
<author><name sortKey="Daee, Pedram" sort="Daee, Pedram" uniqKey="Daee P" first="Pedram" last="Daee">Pedram Daee</name>
<affiliation wicri:level="1"><nlm:aff id="aff1"><addr-line>Cognitive Robotics Laboratory, Control and Intelligent Processing Center of Excellence, School of Electrical and Computer Engineering, College of Engineering, University of Tehran, Tehran, Iran</addr-line>
</nlm:aff>
<country xml:lang="fr">Iran</country>
<wicri:regionArea>Cognitive Robotics Laboratory, Control and Intelligent Processing Center of Excellence, School of Electrical and Computer Engineering, College of Engineering, University of Tehran, Tehran</wicri:regionArea>
<wicri:noRegion>Tehran</wicri:noRegion>
</affiliation>
</author>
<author><name sortKey="Mirian, Maryam S" sort="Mirian, Maryam S" uniqKey="Mirian M" first="Maryam S." last="Mirian">Maryam S. Mirian</name>
<affiliation wicri:level="1"><nlm:aff id="aff1"><addr-line>Cognitive Robotics Laboratory, Control and Intelligent Processing Center of Excellence, School of Electrical and Computer Engineering, College of Engineering, University of Tehran, Tehran, Iran</addr-line>
</nlm:aff>
<country xml:lang="fr">Iran</country>
<wicri:regionArea>Cognitive Robotics Laboratory, Control and Intelligent Processing Center of Excellence, School of Electrical and Computer Engineering, College of Engineering, University of Tehran, Tehran</wicri:regionArea>
<wicri:noRegion>Tehran</wicri:noRegion>
</affiliation>
</author>
<author><name sortKey="Ahmadabadi, Majid Nili" sort="Ahmadabadi, Majid Nili" uniqKey="Ahmadabadi M" first="Majid Nili" last="Ahmadabadi">Majid Nili Ahmadabadi</name>
<affiliation wicri:level="1"><nlm:aff id="aff1"><addr-line>Cognitive Robotics Laboratory, Control and Intelligent Processing Center of Excellence, School of Electrical and Computer Engineering, College of Engineering, University of Tehran, Tehran, Iran</addr-line>
</nlm:aff>
<country xml:lang="fr">Iran</country>
<wicri:regionArea>Cognitive Robotics Laboratory, Control and Intelligent Processing Center of Excellence, School of Electrical and Computer Engineering, College of Engineering, University of Tehran, Tehran</wicri:regionArea>
<wicri:noRegion>Tehran</wicri:noRegion>
</affiliation>
<affiliation wicri:level="1"><nlm:aff id="aff2"><addr-line>School of Cognitive Sciences, Institute for Research in Fundamental Sciences (IPM), Tehran, Iran</addr-line>
</nlm:aff>
<country xml:lang="fr">Iran</country>
<wicri:regionArea>School of Cognitive Sciences, Institute for Research in Fundamental Sciences (IPM), Tehran</wicri:regionArea>
<wicri:noRegion>Tehran</wicri:noRegion>
</affiliation>
</author>
</titleStmt>
<publicationStmt><idno type="wicri:source">PMC</idno>
<idno type="pmid">25058591</idno>
<idno type="pmc">4110011</idno>
<idno type="url">http://www.ncbi.nlm.nih.gov/pmc/articles/PMC4110011</idno>
<idno type="RBID">PMC:4110011</idno>
<idno type="doi">10.1371/journal.pone.0103143</idno>
<date when="2014">2014</date>
<idno type="wicri:Area/Pmc/Corpus">000338</idno>
<idno type="wicri:Area/Pmc/Curation">000338</idno>
<idno type="wicri:Area/Pmc/Checkpoint">000995</idno>
<idno type="wicri:Area/Ncbi/Merge">003163</idno>
<idno type="wicri:Area/Ncbi/Curation">003163</idno>
<idno type="wicri:Area/Ncbi/Checkpoint">003163</idno>
</publicationStmt>
<sourceDesc><biblStruct><analytic><title xml:lang="en" level="a" type="main">Reward Maximization Justifies the Transition from Sensory Selection at Childhood to Sensory Integration at Adulthood</title>
<author><name sortKey="Daee, Pedram" sort="Daee, Pedram" uniqKey="Daee P" first="Pedram" last="Daee">Pedram Daee</name>
<affiliation wicri:level="1"><nlm:aff id="aff1"><addr-line>Cognitive Robotics Laboratory, Control and Intelligent Processing Center of Excellence, School of Electrical and Computer Engineering, College of Engineering, University of Tehran, Tehran, Iran</addr-line>
</nlm:aff>
<country xml:lang="fr">Iran</country>
<wicri:regionArea>Cognitive Robotics Laboratory, Control and Intelligent Processing Center of Excellence, School of Electrical and Computer Engineering, College of Engineering, University of Tehran, Tehran</wicri:regionArea>
<wicri:noRegion>Tehran</wicri:noRegion>
</affiliation>
</author>
<author><name sortKey="Mirian, Maryam S" sort="Mirian, Maryam S" uniqKey="Mirian M" first="Maryam S." last="Mirian">Maryam S. Mirian</name>
<affiliation wicri:level="1"><nlm:aff id="aff1"><addr-line>Cognitive Robotics Laboratory, Control and Intelligent Processing Center of Excellence, School of Electrical and Computer Engineering, College of Engineering, University of Tehran, Tehran, Iran</addr-line>
</nlm:aff>
<country xml:lang="fr">Iran</country>
<wicri:regionArea>Cognitive Robotics Laboratory, Control and Intelligent Processing Center of Excellence, School of Electrical and Computer Engineering, College of Engineering, University of Tehran, Tehran</wicri:regionArea>
<wicri:noRegion>Tehran</wicri:noRegion>
</affiliation>
</author>
<author><name sortKey="Ahmadabadi, Majid Nili" sort="Ahmadabadi, Majid Nili" uniqKey="Ahmadabadi M" first="Majid Nili" last="Ahmadabadi">Majid Nili Ahmadabadi</name>
<affiliation wicri:level="1"><nlm:aff id="aff1"><addr-line>Cognitive Robotics Laboratory, Control and Intelligent Processing Center of Excellence, School of Electrical and Computer Engineering, College of Engineering, University of Tehran, Tehran, Iran</addr-line>
</nlm:aff>
<country xml:lang="fr">Iran</country>
<wicri:regionArea>Cognitive Robotics Laboratory, Control and Intelligent Processing Center of Excellence, School of Electrical and Computer Engineering, College of Engineering, University of Tehran, Tehran</wicri:regionArea>
<wicri:noRegion>Tehran</wicri:noRegion>
</affiliation>
<affiliation wicri:level="1"><nlm:aff id="aff2"><addr-line>School of Cognitive Sciences, Institute for Research in Fundamental Sciences (IPM), Tehran, Iran</addr-line>
</nlm:aff>
<country xml:lang="fr">Iran</country>
<wicri:regionArea>School of Cognitive Sciences, Institute for Research in Fundamental Sciences (IPM), Tehran</wicri:regionArea>
<wicri:noRegion>Tehran</wicri:noRegion>
</affiliation>
</author>
</analytic>
<series><title level="j">PLoS ONE</title>
<idno type="eISSN">1932-6203</idno>
<imprint><date when="2014">2014</date>
</imprint>
</series>
</biblStruct>
</sourceDesc>
</fileDesc>
<profileDesc><textClass></textClass>
</profileDesc>
</teiHeader>
<front><div type="abstract" xml:lang="en"><p>In a multisensory task, human adults integrate information from different sensory modalities -behaviorally in an optimal Bayesian fashion- while children mostly rely on a single sensor modality for decision making. The reason behind this change of behavior over age and the process behind learning the required statistics for optimal integration are still unclear and have not been justified by the conventional Bayesian modeling. We propose an interactive multisensory learning framework without making any prior assumptions about the sensory models. In this framework, learning in every modality and in their joint space is done in parallel using a single-step reinforcement learning method. A simple statistical test on confidence intervals on the mean of reward distributions is used to select the most informative source of information among the individual modalities and the joint space. Analyses of the method and the simulation results on a multimodal localization task show that the learning system autonomously starts with sensory selection and gradually switches to sensory integration. This is because, relying more on modalities -i.e. selection- at early learning steps (childhood) is more rewarding than favoring decisions learned in the joint space since, smaller state-space in modalities results in faster learning in every individual modality. In contrast, after gaining sufficient experiences (adulthood), the quality of learning in the joint space matures while learning in modalities suffers from insufficient accuracy due to perceptual aliasing. It results in tighter confidence interval for the joint space and consequently causes a smooth shift from selection to integration. It suggests that sensory selection and integration are emergent behavior and both are outputs of a single reward maximization process; i.e. the transition is not a preprogrammed phenomenon.</p>
</div>
</front>
<back><div1 type="bibliography"><listBibl><biblStruct><analytic><author><name sortKey="Ernst, Mo" uniqKey="Ernst M">MO Ernst</name>
</author>
<author><name sortKey="Banks, Ms" uniqKey="Banks M">MS Banks</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Alais, D" uniqKey="Alais D">D Alais</name>
</author>
<author><name sortKey="Burr, D" uniqKey="Burr D">D Burr</name>
</author>
</analytic>
</biblStruct>
<biblStruct></biblStruct>
<biblStruct><analytic><author><name sortKey="Gori, M" uniqKey="Gori M">M Gori</name>
</author>
<author><name sortKey="Del Viva, M" uniqKey="Del Viva M">M Del Viva</name>
</author>
<author><name sortKey="Sandini, G" uniqKey="Sandini G">G Sandini</name>
</author>
<author><name sortKey="Burr, Dc" uniqKey="Burr D">DC Burr</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Nardini, M" uniqKey="Nardini M">M Nardini</name>
</author>
<author><name sortKey="Jones, P" uniqKey="Jones P">P Jones</name>
</author>
<author><name sortKey="Bedford, R" uniqKey="Bedford R">R Bedford</name>
</author>
<author><name sortKey="Braddick, O" uniqKey="Braddick O">O Braddick</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Nardini, M" uniqKey="Nardini M">M Nardini</name>
</author>
<author><name sortKey="Bedford, R" uniqKey="Bedford R">R Bedford</name>
</author>
<author><name sortKey="Mareschal, D" uniqKey="Mareschal D">D Mareschal</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Ernst, Mo" uniqKey="Ernst M">MO Ernst</name>
</author>
</analytic>
</biblStruct>
<biblStruct></biblStruct>
<biblStruct><analytic><author><name sortKey="Rangel, A" uniqKey="Rangel A">A Rangel</name>
</author>
<author><name sortKey="Camerer, C" uniqKey="Camerer C">C Camerer</name>
</author>
<author><name sortKey="Montague, Pr" uniqKey="Montague P">PR Montague</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Weisswange, Th" uniqKey="Weisswange T">TH Weisswange</name>
</author>
<author><name sortKey="Rothkopf, Ca" uniqKey="Rothkopf C">CA Rothkopf</name>
</author>
<author><name sortKey="Rodemann, T" uniqKey="Rodemann T">T Rodemann</name>
</author>
<author><name sortKey="Triesch, J" uniqKey="Triesch J">J Triesch</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Firouzi, H" uniqKey="Firouzi H">H Firouzi</name>
</author>
<author><name sortKey="Ahmadabadi, Mn" uniqKey="Ahmadabadi M">MN Ahmadabadi</name>
</author>
<author><name sortKey="Araabi, Bn" uniqKey="Araabi B">BN Araabi</name>
</author>
<author><name sortKey="Amizadeh, S" uniqKey="Amizadeh S">S Amizadeh</name>
</author>
<author><name sortKey="Mirian, Ms" uniqKey="Mirian M">MS Mirian</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Mirian, Ms" uniqKey="Mirian M">MS Mirian</name>
</author>
<author><name sortKey="Ahmadabadi, Mn" uniqKey="Ahmadabadi M">MN Ahmadabadi</name>
</author>
<author><name sortKey="Araabi, Bn" uniqKey="Araabi B">BN Araabi</name>
</author>
<author><name sortKey="Siegwart, Rr" uniqKey="Siegwart R">RR Siegwart</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Whitehead, Sd" uniqKey="Whitehead S">SD Whitehead</name>
</author>
<author><name sortKey="Ballard, Dh" uniqKey="Ballard D">DH Ballard</name>
</author>
</analytic>
</biblStruct>
<biblStruct></biblStruct>
<biblStruct></biblStruct>
<biblStruct></biblStruct>
<biblStruct><analytic><author><name sortKey="Audibert, J Y" uniqKey="Audibert J">J-Y Audibert</name>
</author>
<author><name sortKey="Munos, R" uniqKey="Munos R">R Munos</name>
</author>
<author><name sortKey="Szepesvari, C" uniqKey="Szepesvari C">C Szepesvári</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Lai, T" uniqKey="Lai T">T Lai</name>
</author>
<author><name sortKey="Robbins, H" uniqKey="Robbins H">H Robbins</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Auer, P" uniqKey="Auer P">P Auer</name>
</author>
<author><name sortKey="Cesa Bianchi, N" uniqKey="Cesa Bianchi N">N Cesa-Bianchi</name>
</author>
<author><name sortKey="Fischer, P" uniqKey="Fischer P">P Fischer</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Battaglia, Pw" uniqKey="Battaglia P">PW Battaglia</name>
</author>
<author><name sortKey="Jacobs, Ra" uniqKey="Jacobs R">RA Jacobs</name>
</author>
<author><name sortKey="Aslin, Rn" uniqKey="Aslin R">RN Aslin</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Gori, M" uniqKey="Gori M">M Gori</name>
</author>
<author><name sortKey="Sandini, G" uniqKey="Sandini G">G Sandini</name>
</author>
<author><name sortKey="Burr, D" uniqKey="Burr D">D Burr</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Wallace, Mt" uniqKey="Wallace M">MT Wallace</name>
</author>
<author><name sortKey="Stein, Be" uniqKey="Stein B">BE Stein</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Kording, Kp" uniqKey="Kording K">KP Körding</name>
</author>
<author><name sortKey="Beierholm, U" uniqKey="Beierholm U">U Beierholm</name>
</author>
<author><name sortKey="Ma, Wj" uniqKey="Ma W">WJ Ma</name>
</author>
<author><name sortKey="Quartz, S" uniqKey="Quartz S">S Quartz</name>
</author>
<author><name sortKey="Tenenbaum, Jb" uniqKey="Tenenbaum J">JB Tenenbaum</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Dayan, P" uniqKey="Dayan P">P Dayan</name>
</author>
<author><name sortKey="J Yu, A" uniqKey="J Yu A">A J Yu</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Narain, D" uniqKey="Narain D">D Narain</name>
</author>
<author><name sortKey="Van Beers, Rj" uniqKey="Van Beers R">RJ van Beers</name>
</author>
<author><name sortKey="Smeets, Jbj" uniqKey="Smeets J">JBJ Smeets</name>
</author>
<author><name sortKey="Brenner, E" uniqKey="Brenner E">E Brenner</name>
</author>
</analytic>
</biblStruct>
</listBibl>
</div1>
</back>
</TEI>
<affiliations><list><country><li>Iran</li>
</country>
</list>
<tree><country name="Iran"><noRegion><name sortKey="Daee, Pedram" sort="Daee, Pedram" uniqKey="Daee P" first="Pedram" last="Daee">Pedram Daee</name>
</noRegion>
<name sortKey="Ahmadabadi, Majid Nili" sort="Ahmadabadi, Majid Nili" uniqKey="Ahmadabadi M" first="Majid Nili" last="Ahmadabadi">Majid Nili Ahmadabadi</name>
<name sortKey="Ahmadabadi, Majid Nili" sort="Ahmadabadi, Majid Nili" uniqKey="Ahmadabadi M" first="Majid Nili" last="Ahmadabadi">Majid Nili Ahmadabadi</name>
<name sortKey="Mirian, Maryam S" sort="Mirian, Maryam S" uniqKey="Mirian M" first="Maryam S." last="Mirian">Maryam S. Mirian</name>
</country>
</tree>
</affiliations>
</record>
Pour manipuler ce document sous Unix (Dilib)
EXPLOR_STEP=$WICRI_ROOT/Ticri/CIDE/explor/HapticV1/Data/Ncbi/Checkpoint
HfdSelect -h $EXPLOR_STEP/biblio.hfd -nk 003163 | SxmlIndent | more
Ou
HfdSelect -h $EXPLOR_AREA/Data/Ncbi/Checkpoint/biblio.hfd -nk 003163 | SxmlIndent | more
Pour mettre un lien sur cette page dans le réseau Wicri
{{Explor lien |wiki= Ticri/CIDE |area= HapticV1 |flux= Ncbi |étape= Checkpoint |type= RBID |clé= PMC:4110011 |texte= Reward Maximization Justifies the Transition from Sensory Selection at Childhood to Sensory Integration at Adulthood }}
Pour générer des pages wiki
HfdIndexSelect -h $EXPLOR_AREA/Data/Ncbi/Checkpoint/RBID.i -Sk "pubmed:25058591" \ | HfdSelect -Kh $EXPLOR_AREA/Data/Ncbi/Checkpoint/biblio.hfd \ | NlmPubMed2Wicri -a HapticV1
This area was generated with Dilib version V0.6.23. |