Serveur d'exploration sur les dispositifs haptiques

Attention, ce site est en cours de développement !
Attention, site généré par des moyens informatiques à partir de corpus bruts.
Les informations ne sont donc pas validées.

Reward Maximization Justifies the Transition from Sensory Selection at Childhood to Sensory Integration at Adulthood

Identifieur interne : 000E94 ( Main/Merge ); précédent : 000E93; suivant : 000E95

Reward Maximization Justifies the Transition from Sensory Selection at Childhood to Sensory Integration at Adulthood

Auteurs : Pedram Daee [Iran] ; Maryam S. Mirian [Iran] ; Majid Nili Ahmadabadi [Iran]

Source :

RBID : PMC:4110011

Abstract

In a multisensory task, human adults integrate information from different sensory modalities -behaviorally in an optimal Bayesian fashion- while children mostly rely on a single sensor modality for decision making. The reason behind this change of behavior over age and the process behind learning the required statistics for optimal integration are still unclear and have not been justified by the conventional Bayesian modeling. We propose an interactive multisensory learning framework without making any prior assumptions about the sensory models. In this framework, learning in every modality and in their joint space is done in parallel using a single-step reinforcement learning method. A simple statistical test on confidence intervals on the mean of reward distributions is used to select the most informative source of information among the individual modalities and the joint space. Analyses of the method and the simulation results on a multimodal localization task show that the learning system autonomously starts with sensory selection and gradually switches to sensory integration. This is because, relying more on modalities -i.e. selection- at early learning steps (childhood) is more rewarding than favoring decisions learned in the joint space since, smaller state-space in modalities results in faster learning in every individual modality. In contrast, after gaining sufficient experiences (adulthood), the quality of learning in the joint space matures while learning in modalities suffers from insufficient accuracy due to perceptual aliasing. It results in tighter confidence interval for the joint space and consequently causes a smooth shift from selection to integration. It suggests that sensory selection and integration are emergent behavior and both are outputs of a single reward maximization process; i.e. the transition is not a preprogrammed phenomenon.


Url:
DOI: 10.1371/journal.pone.0103143
PubMed: 25058591
PubMed Central: 4110011

Links toward previous steps (curation, corpus...)


Links to Exploration step

PMC:4110011

Le document en format XML

<record>
<TEI>
<teiHeader>
<fileDesc>
<titleStmt>
<title xml:lang="en">Reward Maximization Justifies the Transition from Sensory Selection at Childhood to Sensory Integration at Adulthood</title>
<author>
<name sortKey="Daee, Pedram" sort="Daee, Pedram" uniqKey="Daee P" first="Pedram" last="Daee">Pedram Daee</name>
<affiliation wicri:level="1">
<nlm:aff id="aff1">
<addr-line>Cognitive Robotics Laboratory, Control and Intelligent Processing Center of Excellence, School of Electrical and Computer Engineering, College of Engineering, University of Tehran, Tehran, Iran</addr-line>
</nlm:aff>
<country xml:lang="fr">Iran</country>
<wicri:regionArea>Cognitive Robotics Laboratory, Control and Intelligent Processing Center of Excellence, School of Electrical and Computer Engineering, College of Engineering, University of Tehran, Tehran</wicri:regionArea>
<wicri:noRegion>Tehran</wicri:noRegion>
</affiliation>
</author>
<author>
<name sortKey="Mirian, Maryam S" sort="Mirian, Maryam S" uniqKey="Mirian M" first="Maryam S." last="Mirian">Maryam S. Mirian</name>
<affiliation wicri:level="1">
<nlm:aff id="aff1">
<addr-line>Cognitive Robotics Laboratory, Control and Intelligent Processing Center of Excellence, School of Electrical and Computer Engineering, College of Engineering, University of Tehran, Tehran, Iran</addr-line>
</nlm:aff>
<country xml:lang="fr">Iran</country>
<wicri:regionArea>Cognitive Robotics Laboratory, Control and Intelligent Processing Center of Excellence, School of Electrical and Computer Engineering, College of Engineering, University of Tehran, Tehran</wicri:regionArea>
<wicri:noRegion>Tehran</wicri:noRegion>
</affiliation>
</author>
<author>
<name sortKey="Ahmadabadi, Majid Nili" sort="Ahmadabadi, Majid Nili" uniqKey="Ahmadabadi M" first="Majid Nili" last="Ahmadabadi">Majid Nili Ahmadabadi</name>
<affiliation wicri:level="1">
<nlm:aff id="aff1">
<addr-line>Cognitive Robotics Laboratory, Control and Intelligent Processing Center of Excellence, School of Electrical and Computer Engineering, College of Engineering, University of Tehran, Tehran, Iran</addr-line>
</nlm:aff>
<country xml:lang="fr">Iran</country>
<wicri:regionArea>Cognitive Robotics Laboratory, Control and Intelligent Processing Center of Excellence, School of Electrical and Computer Engineering, College of Engineering, University of Tehran, Tehran</wicri:regionArea>
<wicri:noRegion>Tehran</wicri:noRegion>
</affiliation>
<affiliation wicri:level="1">
<nlm:aff id="aff2">
<addr-line>School of Cognitive Sciences, Institute for Research in Fundamental Sciences (IPM), Tehran, Iran</addr-line>
</nlm:aff>
<country xml:lang="fr">Iran</country>
<wicri:regionArea>School of Cognitive Sciences, Institute for Research in Fundamental Sciences (IPM), Tehran</wicri:regionArea>
<wicri:noRegion>Tehran</wicri:noRegion>
</affiliation>
</author>
</titleStmt>
<publicationStmt>
<idno type="wicri:source">PMC</idno>
<idno type="pmid">25058591</idno>
<idno type="pmc">4110011</idno>
<idno type="url">http://www.ncbi.nlm.nih.gov/pmc/articles/PMC4110011</idno>
<idno type="RBID">PMC:4110011</idno>
<idno type="doi">10.1371/journal.pone.0103143</idno>
<date when="2014">2014</date>
<idno type="wicri:Area/Pmc/Corpus">000338</idno>
<idno type="wicri:Area/Pmc/Curation">000338</idno>
<idno type="wicri:Area/Pmc/Checkpoint">000995</idno>
<idno type="wicri:Area/Ncbi/Merge">003163</idno>
<idno type="wicri:Area/Ncbi/Curation">003163</idno>
<idno type="wicri:Area/Ncbi/Checkpoint">003163</idno>
<idno type="wicri:Area/Main/Merge">000E94</idno>
</publicationStmt>
<sourceDesc>
<biblStruct>
<analytic>
<title xml:lang="en" level="a" type="main">Reward Maximization Justifies the Transition from Sensory Selection at Childhood to Sensory Integration at Adulthood</title>
<author>
<name sortKey="Daee, Pedram" sort="Daee, Pedram" uniqKey="Daee P" first="Pedram" last="Daee">Pedram Daee</name>
<affiliation wicri:level="1">
<nlm:aff id="aff1">
<addr-line>Cognitive Robotics Laboratory, Control and Intelligent Processing Center of Excellence, School of Electrical and Computer Engineering, College of Engineering, University of Tehran, Tehran, Iran</addr-line>
</nlm:aff>
<country xml:lang="fr">Iran</country>
<wicri:regionArea>Cognitive Robotics Laboratory, Control and Intelligent Processing Center of Excellence, School of Electrical and Computer Engineering, College of Engineering, University of Tehran, Tehran</wicri:regionArea>
<wicri:noRegion>Tehran</wicri:noRegion>
</affiliation>
</author>
<author>
<name sortKey="Mirian, Maryam S" sort="Mirian, Maryam S" uniqKey="Mirian M" first="Maryam S." last="Mirian">Maryam S. Mirian</name>
<affiliation wicri:level="1">
<nlm:aff id="aff1">
<addr-line>Cognitive Robotics Laboratory, Control and Intelligent Processing Center of Excellence, School of Electrical and Computer Engineering, College of Engineering, University of Tehran, Tehran, Iran</addr-line>
</nlm:aff>
<country xml:lang="fr">Iran</country>
<wicri:regionArea>Cognitive Robotics Laboratory, Control and Intelligent Processing Center of Excellence, School of Electrical and Computer Engineering, College of Engineering, University of Tehran, Tehran</wicri:regionArea>
<wicri:noRegion>Tehran</wicri:noRegion>
</affiliation>
</author>
<author>
<name sortKey="Ahmadabadi, Majid Nili" sort="Ahmadabadi, Majid Nili" uniqKey="Ahmadabadi M" first="Majid Nili" last="Ahmadabadi">Majid Nili Ahmadabadi</name>
<affiliation wicri:level="1">
<nlm:aff id="aff1">
<addr-line>Cognitive Robotics Laboratory, Control and Intelligent Processing Center of Excellence, School of Electrical and Computer Engineering, College of Engineering, University of Tehran, Tehran, Iran</addr-line>
</nlm:aff>
<country xml:lang="fr">Iran</country>
<wicri:regionArea>Cognitive Robotics Laboratory, Control and Intelligent Processing Center of Excellence, School of Electrical and Computer Engineering, College of Engineering, University of Tehran, Tehran</wicri:regionArea>
<wicri:noRegion>Tehran</wicri:noRegion>
</affiliation>
<affiliation wicri:level="1">
<nlm:aff id="aff2">
<addr-line>School of Cognitive Sciences, Institute for Research in Fundamental Sciences (IPM), Tehran, Iran</addr-line>
</nlm:aff>
<country xml:lang="fr">Iran</country>
<wicri:regionArea>School of Cognitive Sciences, Institute for Research in Fundamental Sciences (IPM), Tehran</wicri:regionArea>
<wicri:noRegion>Tehran</wicri:noRegion>
</affiliation>
</author>
</analytic>
<series>
<title level="j">PLoS ONE</title>
<idno type="eISSN">1932-6203</idno>
<imprint>
<date when="2014">2014</date>
</imprint>
</series>
</biblStruct>
</sourceDesc>
</fileDesc>
<profileDesc>
<textClass></textClass>
</profileDesc>
</teiHeader>
<front>
<div type="abstract" xml:lang="en">
<p>In a multisensory task, human adults integrate information from different sensory modalities -behaviorally in an optimal Bayesian fashion- while children mostly rely on a single sensor modality for decision making. The reason behind this change of behavior over age and the process behind learning the required statistics for optimal integration are still unclear and have not been justified by the conventional Bayesian modeling. We propose an interactive multisensory learning framework without making any prior assumptions about the sensory models. In this framework, learning in every modality and in their joint space is done in parallel using a single-step reinforcement learning method. A simple statistical test on confidence intervals on the mean of reward distributions is used to select the most informative source of information among the individual modalities and the joint space. Analyses of the method and the simulation results on a multimodal localization task show that the learning system autonomously starts with sensory selection and gradually switches to sensory integration. This is because, relying more on modalities -i.e. selection- at early learning steps (childhood) is more rewarding than favoring decisions learned in the joint space since, smaller state-space in modalities results in faster learning in every individual modality. In contrast, after gaining sufficient experiences (adulthood), the quality of learning in the joint space matures while learning in modalities suffers from insufficient accuracy due to perceptual aliasing. It results in tighter confidence interval for the joint space and consequently causes a smooth shift from selection to integration. It suggests that sensory selection and integration are emergent behavior and both are outputs of a single reward maximization process; i.e. the transition is not a preprogrammed phenomenon.</p>
</div>
</front>
<back>
<div1 type="bibliography">
<listBibl>
<biblStruct>
<analytic>
<author>
<name sortKey="Ernst, Mo" uniqKey="Ernst M">MO Ernst</name>
</author>
<author>
<name sortKey="Banks, Ms" uniqKey="Banks M">MS Banks</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Alais, D" uniqKey="Alais D">D Alais</name>
</author>
<author>
<name sortKey="Burr, D" uniqKey="Burr D">D Burr</name>
</author>
</analytic>
</biblStruct>
<biblStruct></biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Gori, M" uniqKey="Gori M">M Gori</name>
</author>
<author>
<name sortKey="Del Viva, M" uniqKey="Del Viva M">M Del Viva</name>
</author>
<author>
<name sortKey="Sandini, G" uniqKey="Sandini G">G Sandini</name>
</author>
<author>
<name sortKey="Burr, Dc" uniqKey="Burr D">DC Burr</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Nardini, M" uniqKey="Nardini M">M Nardini</name>
</author>
<author>
<name sortKey="Jones, P" uniqKey="Jones P">P Jones</name>
</author>
<author>
<name sortKey="Bedford, R" uniqKey="Bedford R">R Bedford</name>
</author>
<author>
<name sortKey="Braddick, O" uniqKey="Braddick O">O Braddick</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Nardini, M" uniqKey="Nardini M">M Nardini</name>
</author>
<author>
<name sortKey="Bedford, R" uniqKey="Bedford R">R Bedford</name>
</author>
<author>
<name sortKey="Mareschal, D" uniqKey="Mareschal D">D Mareschal</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Ernst, Mo" uniqKey="Ernst M">MO Ernst</name>
</author>
</analytic>
</biblStruct>
<biblStruct></biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Rangel, A" uniqKey="Rangel A">A Rangel</name>
</author>
<author>
<name sortKey="Camerer, C" uniqKey="Camerer C">C Camerer</name>
</author>
<author>
<name sortKey="Montague, Pr" uniqKey="Montague P">PR Montague</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Weisswange, Th" uniqKey="Weisswange T">TH Weisswange</name>
</author>
<author>
<name sortKey="Rothkopf, Ca" uniqKey="Rothkopf C">CA Rothkopf</name>
</author>
<author>
<name sortKey="Rodemann, T" uniqKey="Rodemann T">T Rodemann</name>
</author>
<author>
<name sortKey="Triesch, J" uniqKey="Triesch J">J Triesch</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Firouzi, H" uniqKey="Firouzi H">H Firouzi</name>
</author>
<author>
<name sortKey="Ahmadabadi, Mn" uniqKey="Ahmadabadi M">MN Ahmadabadi</name>
</author>
<author>
<name sortKey="Araabi, Bn" uniqKey="Araabi B">BN Araabi</name>
</author>
<author>
<name sortKey="Amizadeh, S" uniqKey="Amizadeh S">S Amizadeh</name>
</author>
<author>
<name sortKey="Mirian, Ms" uniqKey="Mirian M">MS Mirian</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Mirian, Ms" uniqKey="Mirian M">MS Mirian</name>
</author>
<author>
<name sortKey="Ahmadabadi, Mn" uniqKey="Ahmadabadi M">MN Ahmadabadi</name>
</author>
<author>
<name sortKey="Araabi, Bn" uniqKey="Araabi B">BN Araabi</name>
</author>
<author>
<name sortKey="Siegwart, Rr" uniqKey="Siegwart R">RR Siegwart</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Whitehead, Sd" uniqKey="Whitehead S">SD Whitehead</name>
</author>
<author>
<name sortKey="Ballard, Dh" uniqKey="Ballard D">DH Ballard</name>
</author>
</analytic>
</biblStruct>
<biblStruct></biblStruct>
<biblStruct></biblStruct>
<biblStruct></biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Audibert, J Y" uniqKey="Audibert J">J-Y Audibert</name>
</author>
<author>
<name sortKey="Munos, R" uniqKey="Munos R">R Munos</name>
</author>
<author>
<name sortKey="Szepesvari, C" uniqKey="Szepesvari C">C Szepesvári</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Lai, T" uniqKey="Lai T">T Lai</name>
</author>
<author>
<name sortKey="Robbins, H" uniqKey="Robbins H">H Robbins</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Auer, P" uniqKey="Auer P">P Auer</name>
</author>
<author>
<name sortKey="Cesa Bianchi, N" uniqKey="Cesa Bianchi N">N Cesa-Bianchi</name>
</author>
<author>
<name sortKey="Fischer, P" uniqKey="Fischer P">P Fischer</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Battaglia, Pw" uniqKey="Battaglia P">PW Battaglia</name>
</author>
<author>
<name sortKey="Jacobs, Ra" uniqKey="Jacobs R">RA Jacobs</name>
</author>
<author>
<name sortKey="Aslin, Rn" uniqKey="Aslin R">RN Aslin</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Gori, M" uniqKey="Gori M">M Gori</name>
</author>
<author>
<name sortKey="Sandini, G" uniqKey="Sandini G">G Sandini</name>
</author>
<author>
<name sortKey="Burr, D" uniqKey="Burr D">D Burr</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Wallace, Mt" uniqKey="Wallace M">MT Wallace</name>
</author>
<author>
<name sortKey="Stein, Be" uniqKey="Stein B">BE Stein</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Kording, Kp" uniqKey="Kording K">KP Körding</name>
</author>
<author>
<name sortKey="Beierholm, U" uniqKey="Beierholm U">U Beierholm</name>
</author>
<author>
<name sortKey="Ma, Wj" uniqKey="Ma W">WJ Ma</name>
</author>
<author>
<name sortKey="Quartz, S" uniqKey="Quartz S">S Quartz</name>
</author>
<author>
<name sortKey="Tenenbaum, Jb" uniqKey="Tenenbaum J">JB Tenenbaum</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Dayan, P" uniqKey="Dayan P">P Dayan</name>
</author>
<author>
<name sortKey="J Yu, A" uniqKey="J Yu A">A J Yu</name>
</author>
</analytic>
</biblStruct>
<biblStruct>
<analytic>
<author>
<name sortKey="Narain, D" uniqKey="Narain D">D Narain</name>
</author>
<author>
<name sortKey="Van Beers, Rj" uniqKey="Van Beers R">RJ van Beers</name>
</author>
<author>
<name sortKey="Smeets, Jbj" uniqKey="Smeets J">JBJ Smeets</name>
</author>
<author>
<name sortKey="Brenner, E" uniqKey="Brenner E">E Brenner</name>
</author>
</analytic>
</biblStruct>
</listBibl>
</div1>
</back>
</TEI>
</record>

Pour manipuler ce document sous Unix (Dilib)

EXPLOR_STEP=$WICRI_ROOT/Ticri/CIDE/explor/HapticV1/Data/Main/Merge
HfdSelect -h $EXPLOR_STEP/biblio.hfd -nk 000E94 | SxmlIndent | more

Ou

HfdSelect -h $EXPLOR_AREA/Data/Main/Merge/biblio.hfd -nk 000E94 | SxmlIndent | more

Pour mettre un lien sur cette page dans le réseau Wicri

{{Explor lien
   |wiki=    Ticri/CIDE
   |area=    HapticV1
   |flux=    Main
   |étape=   Merge
   |type=    RBID
   |clé=     PMC:4110011
   |texte=   Reward Maximization Justifies the Transition from Sensory Selection at Childhood to Sensory Integration at Adulthood
}}

Pour générer des pages wiki

HfdIndexSelect -h $EXPLOR_AREA/Data/Main/Merge/RBID.i   -Sk "pubmed:25058591" \
       | HfdSelect -Kh $EXPLOR_AREA/Data/Main/Merge/biblio.hfd   \
       | NlmPubMed2Wicri -a HapticV1 

Wicri

This area was generated with Dilib version V0.6.23.
Data generation: Mon Jun 13 01:09:46 2016. Site generation: Wed Mar 6 09:54:07 2024