Simultaneous learning and filtering without delusions: a Bayes-optimal combination of Predictive Inference and Adaptive Filtering
Identifieur interne : 000556 ( Main/Merge ); précédent : 000555; suivant : 000557Simultaneous learning and filtering without delusions: a Bayes-optimal combination of Predictive Inference and Adaptive Filtering
Auteurs : Jan Kneissler [Allemagne] ; Jan Drugowitsch [Suisse] ; Karl Friston [Royaume-Uni] ; Martin V. Butz [Allemagne]Source :
- Frontiers in Computational Neuroscience [ 1662-5188 ] ; 2015.
Abstract
Predictive coding appears to be one of the fundamental working principles of brain processing. Amongst other aspects, brains often predict the sensory consequences of their own actions. Predictive coding resembles Kalman filtering, where incoming sensory information is filtered to produce prediction errors for subsequent adaptation and learning. However, to generate prediction errors given motor commands, a suitable temporal forward model is required to generate predictions. While in engineering applications, it is usually assumed that this forward model is known, the brain has to learn it. When filtering sensory input and learning from the residual signal in parallel, a fundamental problem arises: the system can enter a delusional loop when filtering the sensory information using an overly trusted forward model. In this case, learning stalls before accurate convergence because uncertainty about the forward model is not properly accommodated. We present a Bayes-optimal solution to this generic and pernicious problem for the case of linear forward models, which we call Predictive Inference and Adaptive Filtering (PIAF). PIAF filters incoming sensory information and learns the forward model simultaneously. We show that PIAF is formally related to Kalman filtering and to the Recursive Least Squares linear approximation method, but combines these procedures in a Bayes optimal fashion. Numerical evaluations confirm that the delusional loop is precluded and that the learning of the forward model is more than 10-times faster when compared to a naive combination of Kalman filtering and Recursive Least Squares.
Url:
DOI: 10.3389/fncom.2015.00047
PubMed: 25983690
PubMed Central: 4415408
Links toward previous steps (curation, corpus...)
- to stream Pmc, to step Corpus: 000161
- to stream Pmc, to step Curation: 000161
- to stream Pmc, to step Checkpoint: 000333
- to stream Ncbi, to step Merge: 003939
- to stream Ncbi, to step Curation: 003939
- to stream Ncbi, to step Checkpoint: 003939
Links to Exploration step
PMC:4415408Le document en format XML
<record><TEI><teiHeader><fileDesc><titleStmt><title xml:lang="en">Simultaneous learning and filtering without delusions: a Bayes-optimal combination of Predictive Inference and Adaptive Filtering</title>
<author><name sortKey="Kneissler, Jan" sort="Kneissler, Jan" uniqKey="Kneissler J" first="Jan" last="Kneissler">Jan Kneissler</name>
<affiliation wicri:level="1"><nlm:aff id="aff1"><institution>Chair of Cognitive Modeling, Department of Computer Science, Faculty of Science, Eberhard Karls University of Tübingen</institution>
<country>Tübingen, Germany</country>
</nlm:aff>
<country xml:lang="fr">Allemagne</country>
<wicri:regionArea></wicri:regionArea>
<wicri:regionArea># see nlm:aff region in country</wicri:regionArea>
</affiliation>
</author>
<author><name sortKey="Drugowitsch, Jan" sort="Drugowitsch, Jan" uniqKey="Drugowitsch J" first="Jan" last="Drugowitsch">Jan Drugowitsch</name>
<affiliation wicri:level="1"><nlm:aff id="aff2"><institution>Départment des Neurosciences Fondamentales, Université de Genève</institution>
<country>Geneva, Switzerland</country>
</nlm:aff>
<country xml:lang="fr">Suisse</country>
<wicri:regionArea></wicri:regionArea>
<wicri:regionArea># see nlm:aff region in country</wicri:regionArea>
</affiliation>
</author>
<author><name sortKey="Friston, Karl" sort="Friston, Karl" uniqKey="Friston K" first="Karl" last="Friston">Karl Friston</name>
<affiliation wicri:level="1"><nlm:aff id="aff3"><institution>The Wellcome Trust Centre for Neuroimaging, Institute of Neurology, University College London</institution>
<country>London, UK</country>
</nlm:aff>
<country xml:lang="fr">Royaume-Uni</country>
<wicri:regionArea></wicri:regionArea>
<wicri:regionArea># see nlm:aff region in country</wicri:regionArea>
</affiliation>
</author>
<author><name sortKey="Butz, Martin V" sort="Butz, Martin V" uniqKey="Butz M" first="Martin V." last="Butz">Martin V. Butz</name>
<affiliation wicri:level="1"><nlm:aff id="aff1"><institution>Chair of Cognitive Modeling, Department of Computer Science, Faculty of Science, Eberhard Karls University of Tübingen</institution>
<country>Tübingen, Germany</country>
</nlm:aff>
<country xml:lang="fr">Allemagne</country>
<wicri:regionArea></wicri:regionArea>
<wicri:regionArea># see nlm:aff region in country</wicri:regionArea>
</affiliation>
</author>
</titleStmt>
<publicationStmt><idno type="wicri:source">PMC</idno>
<idno type="pmid">25983690</idno>
<idno type="pmc">4415408</idno>
<idno type="url">http://www.ncbi.nlm.nih.gov/pmc/articles/PMC4415408</idno>
<idno type="RBID">PMC:4415408</idno>
<idno type="doi">10.3389/fncom.2015.00047</idno>
<date when="2015">2015</date>
<idno type="wicri:Area/Pmc/Corpus">000161</idno>
<idno type="wicri:Area/Pmc/Curation">000161</idno>
<idno type="wicri:Area/Pmc/Checkpoint">000333</idno>
<idno type="wicri:Area/Ncbi/Merge">003939</idno>
<idno type="wicri:Area/Ncbi/Curation">003939</idno>
<idno type="wicri:Area/Ncbi/Checkpoint">003939</idno>
<idno type="wicri:Area/Main/Merge">000556</idno>
</publicationStmt>
<sourceDesc><biblStruct><analytic><title xml:lang="en" level="a" type="main">Simultaneous learning and filtering without delusions: a Bayes-optimal combination of Predictive Inference and Adaptive Filtering</title>
<author><name sortKey="Kneissler, Jan" sort="Kneissler, Jan" uniqKey="Kneissler J" first="Jan" last="Kneissler">Jan Kneissler</name>
<affiliation wicri:level="1"><nlm:aff id="aff1"><institution>Chair of Cognitive Modeling, Department of Computer Science, Faculty of Science, Eberhard Karls University of Tübingen</institution>
<country>Tübingen, Germany</country>
</nlm:aff>
<country xml:lang="fr">Allemagne</country>
<wicri:regionArea></wicri:regionArea>
<wicri:regionArea># see nlm:aff region in country</wicri:regionArea>
</affiliation>
</author>
<author><name sortKey="Drugowitsch, Jan" sort="Drugowitsch, Jan" uniqKey="Drugowitsch J" first="Jan" last="Drugowitsch">Jan Drugowitsch</name>
<affiliation wicri:level="1"><nlm:aff id="aff2"><institution>Départment des Neurosciences Fondamentales, Université de Genève</institution>
<country>Geneva, Switzerland</country>
</nlm:aff>
<country xml:lang="fr">Suisse</country>
<wicri:regionArea></wicri:regionArea>
<wicri:regionArea># see nlm:aff region in country</wicri:regionArea>
</affiliation>
</author>
<author><name sortKey="Friston, Karl" sort="Friston, Karl" uniqKey="Friston K" first="Karl" last="Friston">Karl Friston</name>
<affiliation wicri:level="1"><nlm:aff id="aff3"><institution>The Wellcome Trust Centre for Neuroimaging, Institute of Neurology, University College London</institution>
<country>London, UK</country>
</nlm:aff>
<country xml:lang="fr">Royaume-Uni</country>
<wicri:regionArea></wicri:regionArea>
<wicri:regionArea># see nlm:aff region in country</wicri:regionArea>
</affiliation>
</author>
<author><name sortKey="Butz, Martin V" sort="Butz, Martin V" uniqKey="Butz M" first="Martin V." last="Butz">Martin V. Butz</name>
<affiliation wicri:level="1"><nlm:aff id="aff1"><institution>Chair of Cognitive Modeling, Department of Computer Science, Faculty of Science, Eberhard Karls University of Tübingen</institution>
<country>Tübingen, Germany</country>
</nlm:aff>
<country xml:lang="fr">Allemagne</country>
<wicri:regionArea></wicri:regionArea>
<wicri:regionArea># see nlm:aff region in country</wicri:regionArea>
</affiliation>
</author>
</analytic>
<series><title level="j">Frontiers in Computational Neuroscience</title>
<idno type="eISSN">1662-5188</idno>
<imprint><date when="2015">2015</date>
</imprint>
</series>
</biblStruct>
</sourceDesc>
</fileDesc>
<profileDesc><textClass></textClass>
</profileDesc>
</teiHeader>
<front><div type="abstract" xml:lang="en"><p>Predictive coding appears to be one of the fundamental working principles of brain processing. Amongst other aspects, brains often predict the sensory consequences of their own actions. Predictive coding resembles Kalman filtering, where incoming sensory information is filtered to produce prediction errors for subsequent adaptation and learning. However, to generate prediction errors given motor commands, a suitable temporal forward model is required to generate predictions. While in engineering applications, it is usually assumed that this forward model is known, the brain has to learn it. When filtering sensory input and learning from the residual signal in parallel, a fundamental problem arises: the system can enter a delusional loop when filtering the sensory information using an overly trusted forward model. In this case, learning stalls before accurate convergence because uncertainty about the forward model is not properly accommodated. We present a Bayes-optimal solution to this generic and pernicious problem for the case of linear forward models, which we call Predictive Inference and Adaptive Filtering (PIAF). PIAF filters incoming sensory information and learns the forward model simultaneously. We show that PIAF is formally related to Kalman filtering and to the Recursive Least Squares linear approximation method, but combines these procedures in a Bayes optimal fashion. Numerical evaluations confirm that the delusional loop is precluded and that the learning of the forward model is more than 10-times faster when compared to a naive combination of Kalman filtering and Recursive Least Squares.</p>
</div>
</front>
<back><div1 type="bibliography"><listBibl><biblStruct><analytic><author><name sortKey="Bar, M" uniqKey="Bar M">M. Bar</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Bishop, C M" uniqKey="Bishop C">C. M. Bishop</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Blakemore, S J" uniqKey="Blakemore S">S. J. Blakemore</name>
</author>
<author><name sortKey="Wolpert, D" uniqKey="Wolpert D">D. Wolpert</name>
</author>
<author><name sortKey="Frith, C" uniqKey="Frith C">C. Frith</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Bridgeman, B" uniqKey="Bridgeman B">B. Bridgeman</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Chang, S W C" uniqKey="Chang S">S. W. C. Chang</name>
</author>
<author><name sortKey="Papadimitriou, C" uniqKey="Papadimitriou C">C. Papadimitriou</name>
</author>
<author><name sortKey="Snyder, L H" uniqKey="Snyder L">L. H. Snyder</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Crapse, T B" uniqKey="Crapse T">T. B. Crapse</name>
</author>
<author><name sortKey="Sommer, M A" uniqKey="Sommer M">M. A. Sommer</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Deneve, S" uniqKey="Deneve S">S. Denève</name>
</author>
<author><name sortKey="Pouget, A" uniqKey="Pouget A">A. Pouget</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Ernst, M O" uniqKey="Ernst M">M. O. Ernst</name>
</author>
<author><name sortKey="Banks, M S" uniqKey="Banks M">M. S. Banks</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Friston, K" uniqKey="Friston K">K. Friston</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Friston, K" uniqKey="Friston K">K. Friston</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Friston, K" uniqKey="Friston K">K. Friston</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Friston, K" uniqKey="Friston K">K. Friston</name>
</author>
<author><name sortKey="Kilner, J" uniqKey="Kilner J">J. Kilner</name>
</author>
<author><name sortKey="Harrison, L" uniqKey="Harrison L">L. Harrison</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Gauss, C" uniqKey="Gauss C">C. Gauss</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Goodwin, G" uniqKey="Goodwin G">G. Goodwin</name>
</author>
<author><name sortKey="Sin, K" uniqKey="Sin K">K. Sin</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Helmholtz, H V" uniqKey="Helmholtz H">H. V. Helmholtz</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Kalman, R E" uniqKey="Kalman R">R. E. Kalman</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Kilner, J M" uniqKey="Kilner J">J. M. Kilner</name>
</author>
<author><name sortKey="Friston, K J" uniqKey="Friston K">K. J. Friston</name>
</author>
<author><name sortKey="Frith, C D" uniqKey="Frith C">C. D. Frith</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Kneissler, J" uniqKey="Kneissler J">J. Kneissler</name>
</author>
<author><name sortKey="Stalph, P O" uniqKey="Stalph P">P. O. Stalph</name>
</author>
<author><name sortKey="Drugowitsch, J" uniqKey="Drugowitsch J">J. Drugowitsch</name>
</author>
<author><name sortKey="Butz, M V" uniqKey="Butz M">M. V. Butz</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Kneissler, J" uniqKey="Kneissler J">J. Kneissler</name>
</author>
<author><name sortKey="Stalph, P O" uniqKey="Stalph P">P. O. Stalph</name>
</author>
<author><name sortKey="Drugowitsch, J" uniqKey="Drugowitsch J">J. Drugowitsch</name>
</author>
<author><name sortKey="Butz, M V" uniqKey="Butz M">M. V. Butz</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Konig, P" uniqKey="Konig P">P. König</name>
</author>
<author><name sortKey="Kruger, N" uniqKey="Kruger N">N. Krüger</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Kording, K P" uniqKey="Kording K">K. P. Körding</name>
</author>
<author><name sortKey="Wolpert, D M" uniqKey="Wolpert D">D. M. Wolpert</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Murphy, K P" uniqKey="Murphy K">K. P. Murphy</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Plackett, R L" uniqKey="Plackett R">R. L. Plackett</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Pynn, L K" uniqKey="Pynn L">L. K. Pynn</name>
</author>
<author><name sortKey="Desouza, J F" uniqKey="Desouza J">J. F. DeSouza</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Rao, R P" uniqKey="Rao R">R. P. Rao</name>
</author>
<author><name sortKey="Ballard, D H" uniqKey="Ballard D">D. H. Ballard</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Sommer, M A" uniqKey="Sommer M">M. A. Sommer</name>
</author>
<author><name sortKey="Wurtz, R H" uniqKey="Wurtz R">R. H. Wurtz</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Sperry, R W" uniqKey="Sperry R">R. W. Sperry</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Von Holst, E" uniqKey="Von Holst E">E. von Holst</name>
</author>
<author><name sortKey="Mittelstaedt, H" uniqKey="Mittelstaedt H">H. Mittelstaedt</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Weisberg, S" uniqKey="Weisberg S">S. Weisberg</name>
</author>
</analytic>
</biblStruct>
</listBibl>
</div1>
</back>
</TEI>
</record>
Pour manipuler ce document sous Unix (Dilib)
EXPLOR_STEP=$WICRI_ROOT/Ticri/CIDE/explor/HapticV1/Data/Main/Merge
HfdSelect -h $EXPLOR_STEP/biblio.hfd -nk 000556 | SxmlIndent | more
Ou
HfdSelect -h $EXPLOR_AREA/Data/Main/Merge/biblio.hfd -nk 000556 | SxmlIndent | more
Pour mettre un lien sur cette page dans le réseau Wicri
{{Explor lien |wiki= Ticri/CIDE |area= HapticV1 |flux= Main |étape= Merge |type= RBID |clé= PMC:4415408 |texte= Simultaneous learning and filtering without delusions: a Bayes-optimal combination of Predictive Inference and Adaptive Filtering }}
Pour générer des pages wiki
HfdIndexSelect -h $EXPLOR_AREA/Data/Main/Merge/RBID.i -Sk "pubmed:25983690" \ | HfdSelect -Kh $EXPLOR_AREA/Data/Main/Merge/biblio.hfd \ | NlmPubMed2Wicri -a HapticV1
![]() | This area was generated with Dilib version V0.6.23. | ![]() |