A computational model of perception and action for cognitive robotics
Identifieur interne : 000670 ( Pmc/Curation ); précédent : 000669; suivant : 000671A computational model of perception and action for cognitive robotics
Auteurs : Pascal Haazebroek [Pays-Bas] ; Saskia Van Dantzig [Pays-Bas] ; Bernhard Hommel [Pays-Bas]Source :
- Cognitive Processing [ 1612-4782 ] ; 2011.
Abstract
Robots are increasingly expected to perform tasks in complex environments. To this end, engineers provide them with processing architectures that are based on models of human information processing. In contrast to traditional models, where information processing is typically set up in stages (i.e., from perception to cognition to action), it is increasingly acknowledged by psychologists and robot engineers that perception and action are parts of an interactive and integrated process. In this paper, we present HiTEC, a novel computational (cognitive) model that allows for direct interaction between perception and action as well as for cognitive control, demonstrated by task-related attentional influences. Simulation results show that key behavioral studies can be readily replicated. Three processing aspects of HiTEC are stressed for their importance for cognitive robotics: (1) ideomotor learning of action control, (2) the influence of task context and attention on perception, action planning, and learning, and (3) the interaction between perception and action planning. Implications for the design of cognitive robotics are discussed.
Url:
DOI: 10.1007/s10339-011-0408-x
PubMed: 21597926
PubMed Central: 3206188
Links toward previous steps (curation, corpus...)
- to stream Pmc, to step Corpus: Pour aller vers cette notice dans l'étape Curation :000670
Links to Exploration step
PMC:3206188Le document en format XML
<record><TEI><teiHeader><fileDesc><titleStmt><title xml:lang="en">A computational model of perception and action for cognitive robotics</title>
<author><name sortKey="Haazebroek, Pascal" sort="Haazebroek, Pascal" uniqKey="Haazebroek P" first="Pascal" last="Haazebroek">Pascal Haazebroek</name>
<affiliation wicri:level="1"><nlm:aff id="Aff1">Cognitive Psychology Unit and Leiden Institute for Brain and Cognition, Wassenaarseweg 52, 2333 AK Leiden, The Netherlands</nlm:aff>
<country xml:lang="fr">Pays-Bas</country>
<wicri:regionArea>Cognitive Psychology Unit and Leiden Institute for Brain and Cognition, Wassenaarseweg 52, 2333 AK Leiden</wicri:regionArea>
</affiliation>
</author>
<author><name sortKey="Van Dantzig, Saskia" sort="Van Dantzig, Saskia" uniqKey="Van Dantzig S" first="Saskia" last="Van Dantzig">Saskia Van Dantzig</name>
<affiliation wicri:level="1"><nlm:aff id="Aff1">Cognitive Psychology Unit and Leiden Institute for Brain and Cognition, Wassenaarseweg 52, 2333 AK Leiden, The Netherlands</nlm:aff>
<country xml:lang="fr">Pays-Bas</country>
<wicri:regionArea>Cognitive Psychology Unit and Leiden Institute for Brain and Cognition, Wassenaarseweg 52, 2333 AK Leiden</wicri:regionArea>
</affiliation>
</author>
<author><name sortKey="Hommel, Bernhard" sort="Hommel, Bernhard" uniqKey="Hommel B" first="Bernhard" last="Hommel">Bernhard Hommel</name>
<affiliation wicri:level="1"><nlm:aff id="Aff1">Cognitive Psychology Unit and Leiden Institute for Brain and Cognition, Wassenaarseweg 52, 2333 AK Leiden, The Netherlands</nlm:aff>
<country xml:lang="fr">Pays-Bas</country>
<wicri:regionArea>Cognitive Psychology Unit and Leiden Institute for Brain and Cognition, Wassenaarseweg 52, 2333 AK Leiden</wicri:regionArea>
</affiliation>
</author>
</titleStmt>
<publicationStmt><idno type="wicri:source">PMC</idno>
<idno type="pmid">21597926</idno>
<idno type="pmc">3206188</idno>
<idno type="url">http://www.ncbi.nlm.nih.gov/pmc/articles/PMC3206188</idno>
<idno type="RBID">PMC:3206188</idno>
<idno type="doi">10.1007/s10339-011-0408-x</idno>
<date when="2011">2011</date>
<idno type="wicri:Area/Pmc/Corpus">000670</idno>
<idno type="wicri:Area/Pmc/Curation">000670</idno>
</publicationStmt>
<sourceDesc><biblStruct><analytic><title xml:lang="en" level="a" type="main">A computational model of perception and action for cognitive robotics</title>
<author><name sortKey="Haazebroek, Pascal" sort="Haazebroek, Pascal" uniqKey="Haazebroek P" first="Pascal" last="Haazebroek">Pascal Haazebroek</name>
<affiliation wicri:level="1"><nlm:aff id="Aff1">Cognitive Psychology Unit and Leiden Institute for Brain and Cognition, Wassenaarseweg 52, 2333 AK Leiden, The Netherlands</nlm:aff>
<country xml:lang="fr">Pays-Bas</country>
<wicri:regionArea>Cognitive Psychology Unit and Leiden Institute for Brain and Cognition, Wassenaarseweg 52, 2333 AK Leiden</wicri:regionArea>
</affiliation>
</author>
<author><name sortKey="Van Dantzig, Saskia" sort="Van Dantzig, Saskia" uniqKey="Van Dantzig S" first="Saskia" last="Van Dantzig">Saskia Van Dantzig</name>
<affiliation wicri:level="1"><nlm:aff id="Aff1">Cognitive Psychology Unit and Leiden Institute for Brain and Cognition, Wassenaarseweg 52, 2333 AK Leiden, The Netherlands</nlm:aff>
<country xml:lang="fr">Pays-Bas</country>
<wicri:regionArea>Cognitive Psychology Unit and Leiden Institute for Brain and Cognition, Wassenaarseweg 52, 2333 AK Leiden</wicri:regionArea>
</affiliation>
</author>
<author><name sortKey="Hommel, Bernhard" sort="Hommel, Bernhard" uniqKey="Hommel B" first="Bernhard" last="Hommel">Bernhard Hommel</name>
<affiliation wicri:level="1"><nlm:aff id="Aff1">Cognitive Psychology Unit and Leiden Institute for Brain and Cognition, Wassenaarseweg 52, 2333 AK Leiden, The Netherlands</nlm:aff>
<country xml:lang="fr">Pays-Bas</country>
<wicri:regionArea>Cognitive Psychology Unit and Leiden Institute for Brain and Cognition, Wassenaarseweg 52, 2333 AK Leiden</wicri:regionArea>
</affiliation>
</author>
</analytic>
<series><title level="j">Cognitive Processing</title>
<idno type="ISSN">1612-4782</idno>
<idno type="eISSN">1612-4790</idno>
<imprint><date when="2011">2011</date>
</imprint>
</series>
</biblStruct>
</sourceDesc>
</fileDesc>
<profileDesc><textClass></textClass>
</profileDesc>
</teiHeader>
<front><div type="abstract" xml:lang="en"><p>Robots are increasingly expected to perform tasks in complex environments. To this end, engineers provide them with processing architectures that are based on models of human information processing. In contrast to traditional models, where information processing is typically set up in stages (i.e., from perception to cognition to action), it is increasingly acknowledged by psychologists and robot engineers that perception and action are parts of an interactive and integrated process. In this paper, we present HiTEC, a novel computational (cognitive) model that allows for direct interaction between perception and action as well as for cognitive control, demonstrated by task-related attentional influences. Simulation results show that key behavioral studies can be readily replicated. Three processing aspects of HiTEC are stressed for their importance for cognitive robotics: (1) ideomotor learning of action control, (2) the influence of task context and attention on perception, action planning, and learning, and (3) the interaction between perception and action planning. Implications for the design of cognitive robotics are discussed.</p>
</div>
</front>
<back><div1 type="bibliography"><listBibl><biblStruct></biblStruct>
<biblStruct><analytic><author><name sortKey="Byrne, Md" uniqKey="Byrne M">MD Byrne</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Chen, S" uniqKey="Chen S">S Chen</name>
</author>
<author><name sortKey="Bargh, Ja" uniqKey="Bargh J">JA Bargh</name>
</author>
</analytic>
</biblStruct>
<biblStruct></biblStruct>
<biblStruct><analytic><author><name sortKey="Damasio, Ar" uniqKey="Damasio A">AR Damasio</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Dennett, Dc" uniqKey="Dennett D">DC Dennett</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Deyoe, Ea" uniqKey="Deyoe E">EA DeYoe</name>
</author>
<author><name sortKey="Essen, Dc" uniqKey="Essen D">DC Essen</name>
</author>
</analytic>
</biblStruct>
<biblStruct></biblStruct>
<biblStruct><analytic><author><name sortKey="Elsner, B" uniqKey="Elsner B">B Elsner</name>
</author>
<author><name sortKey="Hommel, B" uniqKey="Hommel B">B Hommel</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Fagioli, S" uniqKey="Fagioli S">S Fagioli</name>
</author>
<author><name sortKey="Hommel, B" uniqKey="Hommel B">B Hommel</name>
</author>
<author><name sortKey="Schubotz, Ri" uniqKey="Schubotz R">RI Schubotz</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Fitzpatrick, P" uniqKey="Fitzpatrick P">P Fitzpatrick</name>
</author>
<author><name sortKey="Metta, G" uniqKey="Metta G">G Metta</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Gibson, Jj" uniqKey="Gibson J">JJ Gibson</name>
</author>
</analytic>
</biblStruct>
<biblStruct></biblStruct>
<biblStruct></biblStruct>
<biblStruct></biblStruct>
<biblStruct><analytic><author><name sortKey="Hoffmann, H" uniqKey="Hoffmann H">H Hoffmann</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Hommel, B" uniqKey="Hommel B">B Hommel</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Hommel, B" uniqKey="Hommel B">B Hommel</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Hommel, B" uniqKey="Hommel B">B Hommel</name>
</author>
<author><name sortKey="Musseler, J" uniqKey="Musseler J">J Müsseler</name>
</author>
<author><name sortKey="Aschersleben, G" uniqKey="Aschersleben G">G Aschersleben</name>
</author>
<author><name sortKey="Prinz, W" uniqKey="Prinz W">W Prinz</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="James, W" uniqKey="James W">W James</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Kieras, De" uniqKey="Kieras D">DE Kieras</name>
</author>
<author><name sortKey="Meyer, De" uniqKey="Meyer D">DE Meyer</name>
</author>
</analytic>
</biblStruct>
<biblStruct></biblStruct>
<biblStruct><analytic><author><name sortKey="Kunde, W" uniqKey="Kunde W">W Kunde</name>
</author>
<author><name sortKey="Koch, I" uniqKey="Koch I">I Koch</name>
</author>
<author><name sortKey="Hoffmann, J" uniqKey="Hoffmann J">J Hoffmann</name>
</author>
</analytic>
</biblStruct>
<biblStruct></biblStruct>
<biblStruct><analytic><author><name sortKey="Montesano, L" uniqKey="Montesano L">L Montesano</name>
</author>
<author><name sortKey="Lopes, M" uniqKey="Lopes M">M Lopes</name>
</author>
<author><name sortKey="Bernardino, A" uniqKey="Bernardino A">A Bernardino</name>
</author>
<author><name sortKey="Santos Victor, J" uniqKey="Santos Victor J">J Santos-Victor</name>
</author>
</analytic>
</biblStruct>
<biblStruct></biblStruct>
<biblStruct><analytic><author><name sortKey="Norman, Da" uniqKey="Norman D">DA Norman</name>
</author>
</analytic>
</biblStruct>
<biblStruct></biblStruct>
<biblStruct></biblStruct>
<biblStruct></biblStruct>
<biblStruct><analytic><author><name sortKey="Prinz, W" uniqKey="Prinz W">W Prinz</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Rizzolatti, G" uniqKey="Rizzolatti G">G Rizzolatti</name>
</author>
<author><name sortKey="Craighero, L" uniqKey="Craighero L">L Craighero</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Rumelhart, De" uniqKey="Rumelhart D">DE Rumelhart</name>
</author>
<author><name sortKey="Hinton, Ge" uniqKey="Hinton G">GE Hinton</name>
</author>
<author><name sortKey="Mcclelland, Jl" uniqKey="Mcclelland J">JL McClelland</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Russell, S" uniqKey="Russell S">S Russell</name>
</author>
<author><name sortKey="Norvig, P" uniqKey="Norvig P">P Norvig</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Simon, Jr" uniqKey="Simon J">JR Simon</name>
</author>
<author><name sortKey="Rudell, Ap" uniqKey="Rudell A">AP Rudell</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Stock, A" uniqKey="Stock A">A Stock</name>
</author>
<author><name sortKey="Stock, C" uniqKey="Stock C">C Stock</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="U Ur, E" uniqKey="U Ur E">E Uğur</name>
</author>
<author><name sortKey=" Ahin, E" uniqKey=" Ahin E">E Şahin</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Dantzig, S" uniqKey="Dantzig S">S Dantzig</name>
</author>
<author><name sortKey="Pecher, D" uniqKey="Pecher D">D Pecher</name>
</author>
<author><name sortKey="Zwaan, Ra" uniqKey="Zwaan R">RA Zwaan</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Worgotter, F" uniqKey="Worgotter F">F Wörgötter</name>
</author>
<author><name sortKey="Agostini, A" uniqKey="Agostini A">A Agostini</name>
</author>
<author><name sortKey="Kruger, N" uniqKey="Kruger N">N Krüger</name>
</author>
<author><name sortKey="Shylo, N" uniqKey="Shylo N">N Shylo</name>
</author>
<author><name sortKey="Porr, B" uniqKey="Porr B">B Porr</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Wykowska, A" uniqKey="Wykowska A">A Wykowska</name>
</author>
<author><name sortKey="Schubo, A" uniqKey="Schubo A">A Schubö</name>
</author>
<author><name sortKey="Hommel, B" uniqKey="Hommel B">B Hommel</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Ziemke, T" uniqKey="Ziemke T">T Ziemke</name>
</author>
<author><name sortKey="Jirenhed, D A" uniqKey="Jirenhed D">D-A Jirenhed</name>
</author>
<author><name sortKey="Hesslow, G" uniqKey="Hesslow G">G Hesslow</name>
</author>
</analytic>
</biblStruct>
</listBibl>
</div1>
</back>
</TEI>
<pmc article-type="case-report"><pmc-dir>properties open_access</pmc-dir>
<front><journal-meta><journal-id journal-id-type="nlm-ta">Cogn Process</journal-id>
<journal-title-group><journal-title>Cognitive Processing</journal-title>
</journal-title-group>
<issn pub-type="ppub">1612-4782</issn>
<issn pub-type="epub">1612-4790</issn>
<publisher><publisher-name>Springer-Verlag</publisher-name>
<publisher-loc>Berlin/Heidelberg</publisher-loc>
</publisher>
</journal-meta>
<article-meta><article-id pub-id-type="pmid">21597926</article-id>
<article-id pub-id-type="pmc">3206188</article-id>
<article-id pub-id-type="publisher-id">408</article-id>
<article-id pub-id-type="doi">10.1007/s10339-011-0408-x</article-id>
<article-categories><subj-group subj-group-type="heading"><subject>Research Report</subject>
</subj-group>
</article-categories>
<title-group><article-title>A computational model of perception and action for cognitive robotics</article-title>
</title-group>
<contrib-group><contrib contrib-type="author" corresp="yes"><name><surname>Haazebroek</surname>
<given-names>Pascal</given-names>
</name>
<address><phone>+31-71-5273654</phone>
<fax>+31-71-5273619</fax>
<email>phaazebroek@fsw.leidenuniv.nl</email>
</address>
<xref ref-type="aff" rid="Aff1"></xref>
</contrib>
<contrib contrib-type="author"><name><surname>van Dantzig</surname>
<given-names>Saskia</given-names>
</name>
<xref ref-type="aff" rid="Aff1"></xref>
</contrib>
<contrib contrib-type="author"><name><surname>Hommel</surname>
<given-names>Bernhard</given-names>
</name>
<xref ref-type="aff" rid="Aff1"></xref>
</contrib>
<aff id="Aff1">Cognitive Psychology Unit and Leiden Institute for Brain and Cognition, Wassenaarseweg 52, 2333 AK Leiden, The Netherlands</aff>
</contrib-group>
<pub-date pub-type="epub"><day>20</day>
<month>5</month>
<year>2011</year>
</pub-date>
<pub-date pub-type="pmc-release"><day>20</day>
<month>5</month>
<year>2011</year>
</pub-date>
<pub-date pub-type="ppub"><month>11</month>
<year>2011</year>
</pub-date>
<volume>12</volume>
<issue>4</issue>
<fpage>355</fpage>
<lpage>365</lpage>
<history><date date-type="received"><day>20</day>
<month>9</month>
<year>2010</year>
</date>
<date date-type="accepted"><day>3</day>
<month>5</month>
<year>2011</year>
</date>
</history>
<permissions><copyright-statement>© The Author(s) 2011</copyright-statement>
</permissions>
<abstract id="Abs1"><p>Robots are increasingly expected to perform tasks in complex environments. To this end, engineers provide them with processing architectures that are based on models of human information processing. In contrast to traditional models, where information processing is typically set up in stages (i.e., from perception to cognition to action), it is increasingly acknowledged by psychologists and robot engineers that perception and action are parts of an interactive and integrated process. In this paper, we present HiTEC, a novel computational (cognitive) model that allows for direct interaction between perception and action as well as for cognitive control, demonstrated by task-related attentional influences. Simulation results show that key behavioral studies can be readily replicated. Three processing aspects of HiTEC are stressed for their importance for cognitive robotics: (1) ideomotor learning of action control, (2) the influence of task context and attention on perception, action planning, and learning, and (3) the interaction between perception and action planning. Implications for the design of cognitive robotics are discussed.</p>
</abstract>
<kwd-group><title>Keywords</title>
<kwd>Integrated processes</kwd>
<kwd>Perception–action interaction</kwd>
<kwd>Computational modeling</kwd>
<kwd>Cognitive robotics</kwd>
<kwd>Common coding</kwd>
<kwd>Ideomotor learning</kwd>
</kwd-group>
<custom-meta-group><custom-meta><meta-name>issue-copyright-statement</meta-name>
<meta-value>© Marta Olivetti Belardinelli and Springer-Verlag 2011</meta-value>
</custom-meta>
</custom-meta-group>
</article-meta>
</front>
<body><sec id="Sec1"><title>Introduction</title>
<p>Robots are increasingly expected to autonomously fulfill a variety of tasks and duties in real-world environments that are constantly changing. In order to cope with these demands, robots cannot rely on predefined rules of behavior or fixed sets of perceivable objects or action routines. Rather, they need to be able to learn how to segregate and recognize novel objects (e.g., Kraft et al. <xref ref-type="bibr" rid="CR21">2008</xref>
), how to perceive their own movements (e.g., Fitzpatrick and Metta <xref ref-type="bibr" rid="CR11">2003</xref>
), and what actions can be performed on objects in order to achieve certain effects (e.g., Montesano et al. <xref ref-type="bibr" rid="CR24">2008</xref>
).</p>
<p>In this ultimate robot engineering challenge, the nature of perception, action, and cognition plays an important role. Traditionally, these domains are assumed to reflect different stages of information processing (e.g., Donders <xref ref-type="bibr" rid="CR8">1868</xref>
; Neisser <xref ref-type="bibr" rid="CR25">1967</xref>
; Norman <xref ref-type="bibr" rid="CR26">1988</xref>
): first, objects are perceived and recognized; subsequently, based on the current situation, task, and goal, the optimal action is determined; and finally, the selected action is prepared and executed. However, new robot architectures increasingly recognize the benefits of integration across these domains. Some roboticists have focused on creating (perceptually defined) anticipations that guide action selection and motor control (e.g., Hoffmann <xref ref-type="bibr" rid="CR15">2007</xref>
; Ziemke et al. <xref ref-type="bibr" rid="CR41">2005</xref>
). Others stress the importance of the acquisition and use of affordances (after Gibson <xref ref-type="bibr" rid="CR12">1979</xref>
) in navigation (e.g., Uğur and Şahin <xref ref-type="bibr" rid="CR36">2010</xref>
), action selection (e.g., Cos-Aguilera et al. <xref ref-type="bibr" rid="CR4">2004</xref>
; Kraft et al. <xref ref-type="bibr" rid="CR21">2008</xref>
), and imitation (e.g., Fitzpatrick and Metta <xref ref-type="bibr" rid="CR11">2003</xref>
). Also, some approaches propose active perception strategies (e.g., Hoffmann <xref ref-type="bibr" rid="CR15">2007</xref>
; Lacroix et al. <xref ref-type="bibr" rid="CR23">2006</xref>
; Ognibene et al. <xref ref-type="bibr" rid="CR27">2008</xref>
) that include epistemic sensing actions (e.g., eye movements) that actively perceive features necessary for object recognition or for the planning of further actions.</p>
<p>In our laboratory, we study perception and action in human performance. Findings in behavioral and neurocognitive studies have shed new light on the interaction between perception and action, indicating that these processes are not as separate and stage-like as has been presumed. First, features of perceived objects (such as location, orientation, and size) seem to influence actions directly and beyond cognitive control, as illustrated by stimulus-response compatibility phenomena, such as the Simon effect (Simon and Rudell <xref ref-type="bibr" rid="CR34">1967</xref>
). This suggests that there is a direct route from perception to action that can bypass cognition. Second, in monkeys, neural substrates (i.e., so-called mirror neurons) have been discovered that are active both when the monkey performs a particular action and when it perceives the same action carried out by another monkey or human (Rizzolatti and Craighero <xref ref-type="bibr" rid="CR31">2004</xref>
). This suggests that common representations exist for action planning and action perception. Finally, behavioral studies show that, in humans, action planning can actually influence object perception (Fagioli et al. <xref ref-type="bibr" rid="CR10">2007</xref>
; Wykowska et al. <xref ref-type="bibr" rid="CR39">2009</xref>
), suggesting that perceptual processes and action processes overlap in time.</p>
<p>In order to integrate these findings, we have developed a novel cognitive architecture that allows for the simulation of a variety of behavioral phenomena. We believe that our computational model includes processing aspects of human perception, action, and cognition that may be of special interest to designers of cognitive robots.</p>
<p>In this paper, we argue that in addition to representations that include both perceptual and action-related features (e.g., Wörgötter et al. <xref ref-type="bibr" rid="CR38">2009</xref>
), perception, and action may also be intertwined with respect to their processes. First, we discuss the theoretical foundation of our work (the Theory of Event Coding: TEC) and describe our recently developed computational model, called HiTEC (Haazebroek et al. submitted). Then, we discuss a number of simulations of behavioral phenomena that illustrate the principles of the processing architecture underlying HiTEC. Finally, we discuss the wider implications of our approach for the design of cognitive robotics.</p>
</sec>
<sec id="Sec2"><title>HiTEC</title>
<sec id="Sec3"><title>Theory of event coding</title>
<p>The theoretical basis of our approach is the Theory of Event Coding (TEC, Hommel et al. <xref ref-type="bibr" rid="CR18">2001</xref>
), a general theoretical framework addressing how perceived events (i.e., stimuli) and produced events (i.e., actions) are cognitively represented and how their representations interact to generate perceptions and action plans. TEC claims that stimuli and actions are represented in the same way and by using the same “feature codes”. These codes refer to the distal features of objects and events in the environment, such as shape, size, distance, and location, rather than to proximal features of the sensations elicited by stimuli (e.g., retinal location or auditory intensity). For example, a haptic sensation on the left hand and a visual stimulus on the left both activate the same distal code representing “left”.</p>
<p>Feature codes can represent the properties of a stimulus in the environment just as well as the properties of a response—which, after all, is a perceivable stimulus event itself. This theoretical assumption is derived from ideomotor theory (James <xref ref-type="bibr" rid="CR19">1890</xref>
; see Stock and Stock <xref ref-type="bibr" rid="CR35">2004</xref>
, for a historical overview), which presumes that actions are cognitively represented in terms of their perceivable effects. According to the ideomotor principle, when one executes a particular action, the motor pattern is automatically associated to the perceptual input representing the action’s effects (action effect learning: Elsner and Hommel <xref ref-type="bibr" rid="CR9">2001</xref>
). Based on these action effect associations, people can subsequently plan and control (Hommel <xref ref-type="bibr" rid="CR17">2009</xref>
) a motor action by anticipating its perceptual effects, that is, (re-)activate a motor pattern by intentionally (re-)activating the associated feature codes. Thus, stimuli and actions are represented in a common representational medium (Prinz <xref ref-type="bibr" rid="CR30">1990</xref>
). Furthermore, stimulus perception and action planning are considered to be similar processes: both involve activating feature codes that represent external events.</p>
<p>Finally, TEC stresses the role of task context in stimulus and response coding. In particular, the responsiveness of feature codes to activation sources is modulated according to the task or goals at hand (the intentional weighting principle). For example, if the task is to grasp an object, features codes representing features relevant for grasping (such as the object’s shape, size, location, and orientation) will be enhanced, while feature codes representing irrelevant features (such as the object’s color or sound) will be attenuated.</p>
<p>In our work, we address how these principles may be computationally realized. To this end, we have developed a computational model, called HiTEC, and tested its performance against empirical data from human studies on various types of perception–action interactions (Haazebroek et al. submitted). In this paper, two simulations are described, illustrating the aspects that are of particular relevance for information processing in cognitive robotics.</p>
</sec>
<sec id="Sec4"><title>HiTEC’s structure and representations</title>
<p>HiTEC is implemented as a connectionist network model that uses the basic building blocks of parallel distributed processing (PDP; e.g., Rumelhart et al. <xref ref-type="bibr" rid="CR32">1986</xref>
). In a PDP model, processing occurs through the interactions of a number of interconnected elements called units. Units may be organized into higher order structures, called modules. Each unit has an activation value indicating local activity. Processing occurs by propagating activity through the network, that is, by propagating activation from one unit to the other, via weighted connections. When a connection between two units is positively weighted, the connection is excitatory and the units will increase each other’s activation. When the connection is negatively weighted, it is inhibitory and the units will reduce each other’s activation. Processing starts when one or more units receive some sort of external input. Gradually, unit activations will change and propagate through the network while interactions between units control the flow of processing. Some units are designated output units. When the activation of any one of these units reaches a certain threshold, the network is said to produce the corresponding output.</p>
<p>In HiTEC, the elementary units are codes that may be connected and are contained within maps (HiTEC’s modules). Codes within the same map compete for activation by means of lateral inhibitory connections. As illustrated in Fig. <xref rid="Fig1" ref-type="fig">1</xref>
, maps are organized into three levels: the sensory-motor level, the feature level, and the task level. Each level will now be discussed in more detail.<fig id="Fig1"><label>Fig. 1</label>
<caption><p>HiTEC architecture as used for simulation of the Simon effect (see “<xref rid="Sec15" ref-type="sec">Simulations section</xref>
”). Codes reside in maps on different levels and are connected by excitatory associations. <italic>Solid lines</italic>
denote fixed weights, <italic>dashed lines</italic>
are connections with learned weights. Sensory codes receive modulated excitation from feature codes, denoted by the <italic>open arrows</italic>
</p>
</caption>
<graphic xlink:href="10339_2011_408_Fig1_HTML" id="MO1"></graphic>
</fig>
</p>
<sec id="Sec5"><title>Sensory-motor level</title>
<p>The primate brain encodes perceived objects in a distributed fashion; different features are processed and represented across different cortical maps (e.g., DeYoe and Van Essen <xref ref-type="bibr" rid="CR7">1988</xref>
). In HiTEC, different perceptual modalities (e.g., visual, auditory, tactile, proprioceptive) and different dimensions within each modality (e.g., visual color and shape, auditory location and pitch) are processed and represented in different sensory maps. Each sensory map contains a number of sensory codes that are responsive to specific sensory features (e.g., a specific color or a specific pitch). Note that Fig. <xref rid="Fig1" ref-type="fig">1</xref>
shows only the sensory maps that are relevant for modeling the Simon effect (Simulation 2 in the Simulations section): auditory pitch, auditory location, and haptic location. However, other specific instances of the model may include other sensory maps as well (e.g., visual maps).</p>
<p>The sensory-motor level also contains motor codes, referring to more or less specific movements (e.g., the muscle contractions that produce the movement of the hand pressing a certain key). Although motor codes could also be organized in multiple maps, in the present version of HiTEC, we consider only one basic motor map with a set of motor codes.</p>
</sec>
<sec id="Sec6"><title>Feature level</title>
<p>TEC’s notion of “feature codes” is captured by codes that are connected to and thus grounded in both sensory codes and motor codes. Crucially, the same (distal) feature code (e.g., “left”) can be connected to multiple sensory codes (e.g., “left haptic location” and “left auditory location”). Thus, information from different sensory modalities and dimensions is combined in one feature code representation. Although feature codes are considered to arise from experience, in the present HiTEC simulations, we assume the existence of a set of feature codes (and their connections to sensory codes) to bootstrap the process of extracting sensorimotor regularities in interactions with the environment.</p>
</sec>
<sec id="Sec7"><title>Task level</title>
<p>The task level contains generic task codes that reflect alternative ways to wire and weigh existing representations to prepare for and carry out a particular task. Task codes connect to both the feature codes that represent stimuli and the feature codes that represent responses, in correspondence with the current task context.</p>
</sec>
<sec id="Sec8"><title>Associations</title>
<p>In HiTEC, codes are associated. Some are considered innate or reflecting prior experience (depicted as solid lines in Fig. <xref rid="Fig1" ref-type="fig">1</xref>
), others are learned during the simulation (depicted as dashed lines in Fig. <xref rid="Fig1" ref-type="fig">1</xref>
). This will be elaborated in the next subsection.</p>
</sec>
</sec>
<sec id="Sec9"><title>HiTEC’s processes</title>
<p>In general, codes can be stimulated, which results in an increase in their activation level. Gradually, activation will flow toward other codes through the connections. Note that connections are bidirectional (except for the learned feature code—motor code associations), which results in activation flowing back and forth between sensory codes, feature codes, and task codes and activation flowing toward motor codes. In addition, codes within the same map inhibit each other. Together, this results in a global competition mechanism in which all codes participate from the first processing cycle to the last.</p>
<sec id="Sec10"><title>Ideomotor learning</title>
<p>Associations between feature codes and motor codes are explicitly learned as follows. A random motor code is activated (comparable to the spontaneous “motor babbling” behavior of newborns) first. This leads to a change in the environment (e.g., the left hand suddenly touches an object) that is registered by sensory codes. Activation propagates from sensory codes toward feature codes. Subsequently, the system forms associations between the active feature codes and the active motor code. The weight change of these associations depends on the level of activation of both the motor code and the feature codes during learning.</p>
</sec>
<sec id="Sec11"><title>Action planning</title>
<p>Once associations between motor codes and feature codes exist, they can be used to select and plan actions. Planning an action is realized by activating the feature codes that correspond to its perceptual effects and by propagating their activation toward the associated motor codes. Initially, multiple motor codes may become active as they typically fan out associations to multiple feature codes. However, some motor codes will have more associated features and some of the associations between motor codes and feature codes may be stronger than others. In time, the network converges toward a state where only one motor code is strongly activated, which leads to the selection of that motor action.</p>
</sec>
<sec id="Sec12"><title>Task preparation</title>
<p>In behavioral experiments, participants typically receive a verbal instruction of the task. In HiTEC, a verbal task instruction is assumed to directly activate the respective feature codes. The cognitive system connects these feature codes to task codes. When the model receives several instructions to respond differently to various stimuli, different task codes are recruited and maintained for the various options. Due to the mutual inhibitory links between these task codes, they will compete with each other during the task. Currently, the associations between feature codes and task codes are set by hand.</p>
</sec>
<sec id="Sec13"><title>Responding to stimuli</title>
<p>When a stimulus in an experimental trial is presented, its sensory features will activate a set of feature codes allowing activation to propagate toward one or more task codes, which were already associated during task preparation. Competition takes place between feature codes, between task codes, and between motor codes, simultaneously. Once any one of the motor codes is activated strongly enough, it leads to the execution of the respective motor response to the presented stimulus. In our simulations, this marks the end of a trial. In general, the passing of activation between codes along their connections is iterated for a number of cycles, which allows for the simulation of reaction time (i.e., number of cycles from stimulus onset to response selection) until the activation level of any one of the motor code reaches a set threshold value.</p>
</sec>
</sec>
<sec id="Sec14"><title>Neural network implementation</title>
<p>All HiTEC codes—sensory codes, motor codes, task codes, and feature codes alike—are implemented as generic units with an activation value bound between 0.0 and 1.0. Stimulus presentation is simulated by setting the external input values for the sensory codes. In addition, codes receive input from other, connected codes. In sum, their activation level is updated each processing cycle according to the following function:<disp-formula id="Equa"><alternatives><tex-math id="M1">\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$ A(t + 1) = \left( {1 - d} \right) \times \;A(t) + (Ext + Exc{\kern 1pt} \; + Bg) \times \left( {1 - A(t)} \right) + Inh \times A(t) $$\end{document}</tex-math>
<graphic xlink:href="10339_2011_408_Article_Equa.gif" position="anchor"></graphic>
</alternatives>
</disp-formula>
</p>
<p>Here, A(t) denotes the activation of node at time <italic>t</italic>
, <italic>d</italic>
is a decay term, <italic>Ext</italic>
is its external input (sensory codes only), <italic>Exc</italic>
is its excitatory input (bottom up and top down), <italic>Bg</italic>
is additive background noise, and <italic>Inh</italic>
is its inhibitory input. Note that we first compute all input values to all codes and then update their respective activation values, resulting in (simulated) synchronous updating. Ideomotor weights (i.e., weights of connections between feature codes and motor codes) are acquired during learning trials, using the following Hebbian learning rule:<disp-formula id="Equb"><alternatives><tex-math id="M2">\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$ w{\kern 1pt}_{jk} (t + 1) = (1 - d_{{}} ) \times w_{jk} (t) + LR\; \times Act_{j} (t)\; \times Act_{k} (t)\; \times \left( {1 - w_{jk} (t)} \right) $$\end{document}</tex-math>
<graphic xlink:href="10339_2011_408_Article_Equb.gif" position="anchor"></graphic>
</alternatives>
</disp-formula>
</p>
<p>Here, <italic>w</italic>
<sub><italic>ij</italic>
</sub>
denotes the weight between nodes <italic>j</italic>
and <italic>k</italic>
at time <italic>t</italic>
, <italic>d</italic>
is a decay term, <italic>LR</italic>
is the learning rate, and <italic>Act</italic>
<sub><italic>j</italic>
</sub>
and <italic>Act</italic>
<sub><italic>k</italic>
</sub>
refer to the activation levels at time <italic>t</italic>
of nodes <italic>j</italic>
and <italic>k</italic>
, respectively.</p>
<p>Note that we register a stimulus (or action effect) by simply providing input values to the relevant sensory code(s). In a real robotic setup, these sensory codes could be grounded in the environment, either by defining this a priori or by generating the sensory codes by means of unsupervised clustering techniques (e.g., the category formation phase in Montesano et al. <xref ref-type="bibr" rid="CR24">2008</xref>
). Also note that, in principle, our model is not restricted to any number or type of sensory codes, as long as one can find a reasonable way to ground their stimulation in actual (robotic) sensor values. In simulations, we use specific instances of the model that include only those codes we need for the simulation at hand. Nothing, however, prohibits us from including other codes as well. The fact that only those codes that are connected to higher level feature and task codes (resulting from the task internalization) receive top-down enhancement makes that only a selection of available codes matter for further processing and other sensory stimulation is to be ignored (unless strongly salient). Also note that the time dimension is actually of value to us. Rather than computing a perception–action mapping or function as fast as possible—as is common in robotics algorithms—taking more time for a computation actually reflects the (cognitive or perception–action related) effort needed for the task at hand. Consequently, apart from accuracy scores, we also obtain reaction times that vary as a function of the difficulty of the task. For further computational details, we refer to Haazebroek et al. (submitted).</p>
</sec>
</sec>
<sec id="Sec15"><title>Simulations</title>
<p>The HiTEC computational model has been tested against a variety of behavioral phenomena. Three processing aspects of the model are of particular interest: (1) ideomotor learning of action control, (2) the influence of task context and attention on both perception and action planning, and (3) the interaction between perception and action planning. For the purpose of this paper, these processing aspects are illustrated by simulating two behavioral studies: a study on response-action effect compatibility, conducted by Kunde et al. (<xref ref-type="bibr" rid="CR22">2004</xref>
) and the Simon task (Simon and Rudell <xref ref-type="bibr" rid="CR34">1967</xref>
). We now elaborate on these paradigms and discuss the results of the simulations in HiTEC.</p>
<sec id="Sec16"><title>Simulation 1</title>
<p>In earlier studies (e.g., Elsner and Hommel <xref ref-type="bibr" rid="CR9">2001</xref>
), it has been shown that people automatically learn associations between motor actions and their perceptual effects. An experiment by Kunde et al. (<xref ref-type="bibr" rid="CR22">2004</xref>
) demonstrates that performance is also affected by the compatibility between responses and novel (auditory) action effects. In this experiment, participants had to respond to the color of a visual stimulus by pressing a key forcefully or softly. The key presses were immediately followed by a loud or soft tone. For one group of participants, responses were followed by a compatible action effect; the loudness of the tone matched the response force (e.g., a loud tone appeared after a forceful key press). In the other group of participants, the relationship between actions and action effects was incompatible (e.g., a soft tone appeared after a forceful key press). If the intensity of an action (e.g., a forceful response) was compatible with the intensity of the action effect (e.g., a loud tone), then responses were faster than if the intensity of the action and its effect were incompatible. Given that the tones did not appear before the responses were executed, this observation suggests that the novel, just acquired action effects were anticipated and considered in the response selection process.</p>
<p>In HiTEC, this experiment is simulated using the model as depicted in Fig. <xref rid="Fig2" ref-type="fig">2</xref>
. Here, visual colors, auditory intensity, and haptic intensity are coded by their respective sensory codes. At the feature level, generic intensity feature codes exist that code for both auditory and haptic intensity. The motor codes refer to the soft and forceful key presses, respectively. The bindings between feature codes and task codes follow the task instructions: red is to be responded to by a strong key press, green by a weak key press. As an equivalent of the behavioral study, we allow the model to learn the relationship between key presses and their perceptual effects. This is realized by randomly activating one of the two motor codes (i.e., pressing the key softly or forcefully), registering their sensory effects (i.e., both the key press and the tone) by activating the respective sensory codes, and propagating activation toward the feature codes. As a result, the active motor code and the active feature codes become (more strongly) associated. Thus, ideomotor learning takes place; actions are associated with their effects.<fig id="Fig2"><label>Fig. 2</label>
<caption><p>HiTEC architecture as used for simulation of the experiment by Kunde et al. (<xref ref-type="bibr" rid="CR22">2004</xref>
). Both auditory intensity and haptic intensity project to the general intensity feature dimension</p>
</caption>
<graphic xlink:href="10339_2011_408_Fig2_HTML" id="MO4"></graphic>
</fig>
</p>
<p>Importantly, trials with incompatible action effects result in simultaneous activation of both “strong” and “weak” feature codes. Moreover, these feature codes inhibit each other. As a result, associations learned between feature codes and motor codes are weaker (and less specific) than in trials with compatible action effects. As these associations (co-)determine the processing speed during experimental trials, group differences in reaction time arise: 24.16 cycles (SD = 0.20) for the compatible group and 30.64 cycles (SD = 4.10) for the incompatible group. These results fit well with available behavioral data as shown in Fig. <xref rid="Fig3" ref-type="fig">3</xref>
. Thus, regular and compatible action effects allow for faster anticipation of a motor action resulting in faster responses to stimuli in the environment than when action effects are incompatible.<fig id="Fig3"><label>Fig. 3</label>
<caption><p>Simulation results (<italic>left panel</italic>
) compared with behavioral data (<italic>right panel</italic>
, adopted from Kunde et al., <xref ref-type="bibr" rid="CR22">2004</xref>
)</p>
</caption>
<graphic xlink:href="10339_2011_408_Fig3_HTML" id="MO5"></graphic>
</fig>
</p>
<p>Crucially, participants in behavioral studies typically receive a task instruction before performing practice trials. This is simulated by internalizing the task instruction as feature code—task code connections already before performing the ideomotor learning. As a consequence, activation also propagates from the haptic intensity sensory codes to the “Key” feature code to the task codes—and back—during ideomotor learning, resulting in a top-down enhancement of the haptic intensity sensory codes as compared to the auditory intensity sensory codes. While both haptic intensity and auditory intensity sensory codes receive equal external stimulation from the environment, haptic intensity comes to determine the learned connection weights, where auditory intensity only moderates this process. Thus, the task instruction not only specifies the actual S-R mappings that reflect the appropriate responses to the relevant stimulus features, it also configures the model in such a way that “most attention is paid” to those action effect features in the environment that matter for the current task. Indeed, additional action effects (i.e., the auditory intensity in this task) do not escape processing completely (hence the compatibility effect), but their influence is strongly limited as compared to the main action effect dimension (i.e., the haptic intensity). This illustrates the role of task context and attention in ideomotor learning of action control.</p>
</sec>
<sec id="Sec17"><title>Simulation 2</title>
<p>The canonical example of stimulus-response compatibility effects is the Simon task. In this task, the participant performs manual, spatially defined responses (e.g., pressing a left or right key) to a nonspatial feature of a stimulus (e.g., the pitch of a tone). Importantly, the location of the stimulus varies randomly. Even though stimulus location is irrelevant for the response choice, performance is facilitated when stimulus location corresponds spatially to the correct response. Conversely, performance is impaired when stimulus location corresponds spatially to the other, not to be chosen response.</p>
<p>The Simon task is simulated in HiTEC using the model as depicted in Fig. <xref rid="Fig1" ref-type="fig">1</xref>
. There are sensory codes for auditory pitch levels, auditory locations, and haptic locations. The motor codes refer to the left key press and the right key press motoric responses, respectively. At the feature level, generic pitch feature codes as well as generic location codes are included, as is a general “Key” code that allows the system to code for all key-related features in a simple way.</p>
<p>Crucially, the “Left” and “Right” feature codes are used both for encoding (egocentric) stimulus location (i.e., they are connected to auditory location sensory codes) and for encoding (egocentric) response location (i.e., they are connected to haptic location sensory codes). When a tone stimulus is presented, auditory sensory codes are activated, activation propagates gradually toward pitch and location feature codes, toward task codes and (again) toward location feature codes. Over time, the motor codes also become activated until one of the motor codes reaches a threshold level and is executed. Simulation results thus yield a clear compatibility effect. On average, the compatible trials require 19.79 cycles (SD: 0.18), neutral trials 25.28 (SD: 0.23) cycles, and incompatible trials 34.04 (SD: 0.73) cycles. These results fit well with the available behavioral data (Simon and Rudell <xref ref-type="bibr" rid="CR34">1967</xref>
) as is shown in Fig. <xref rid="Fig4" ref-type="fig">4</xref>
.<fig id="Fig4"><label>Fig. 4</label>
<caption><p>Results of simulation of the Simon task (<italic>left panel</italic>
) compared with behavioral data (<italic>right panel</italic>
, adopted from Simon and Rudell <xref ref-type="bibr" rid="CR34">1967</xref>
)</p>
</caption>
<graphic xlink:href="10339_2011_408_Fig4_HTML" id="MO6"></graphic>
</fig>
</p>
<p>To understand the source of the compatibility effect in this model, consider the following compatible trial: a high tone is presented on the left. This activates the auditory sensory codes S<sub>high</sub>
and S<sub>left</sub>
. Activation propagates to the feature codes F<sub>high</sub>
and F<sub>left</sub>
and to task code T<sub>1</sub>
. Because the task is to respond to high tones with a left key press, activation flows from T<sub>1</sub>
to F<sub>left</sub>
and from there to M<sub>1</sub>
(left response). As soon as the motor activation reaches a threshold, the action is executed (i.e., the left key is pressed). Now, consider an incompatible trial: a high tone is presented on the right. This activates the auditory sensory codes S<sub>high</sub>
and S<sub>right</sub>
. Activation propagates to the feature codes F<sub>high</sub>
and F<sub>right</sub>
and to task code T<sub>1</sub>
. Activation flows from T<sub>1</sub>
to F<sub>left</sub>
. Because both F<sub>left</sub>
and F<sub>right</sub>
are activated, activation is propagated to both motor codes. As a result, competition arises at different levels of the model, which results in a longer response time.</p>
<p>Thus, because common feature codes are used to represent both stimulus features and response features, stimulus-response compatibility effects are bound to occur. In the case of this simulation of the Simon effect, although the location of the stimulus is irrelevant for the task, location is relevant for the anticipation (thus planning) of the appropriate response. Now, the model is, in a sense, forced to also process the stimulus location and—automatically—bias the planning of the action response, generating the Simon effect. Thus, again ideomotor learning is influenced by the current task. In addition, automatic interaction between perception and action causes compatibility effects. Still, even this automatic interaction arises from the task that defines the stimulus features and response (effect) features that are to be used in planning a response to the presented stimulus.</p>
</sec>
</sec>
<sec id="Sec18"><title>Discussion</title>
<p>In this paper, we argue that perception and action are not only intertwined with regard to their representations, but may also be intertwined with respect to their processes, in both humans and artificial cognitive systems. To demonstrate this, we have presented a computational model, HiTEC, which is able to replicate key findings in psychological research (Haazebroek et al. submitted). Three processing aspects of the model may be of particular interest for cognitive robotics: ideomotor learning of action control, the role of task context and attention, and the interaction between perception and action. These aspects, as well as implications for anticipation and affordances—two important themes in cognitive robotics—are discussed.</p>
<sec id="Sec19"><title>Ideomotor learning of action control</title>
<p>The first aspect concerns the ideomotor learning of action control. When working with robots in real-world environments, it is quite common to assume a predefined set of (re)actions and let the robot learn whether these actions can be applied to certain objects (e.g., Cos-Aguilera et al. <xref ref-type="bibr" rid="CR4">2004</xref>
; Kraft et al. <xref ref-type="bibr" rid="CR21">2008</xref>
). However, it is often hard to define a priori exactly which actions can be performed by the robot given the characteristics of the robot body and the physical environment. Moreover, the same robot body can have different action capabilities in different (or changing) environments. Thus, it makes sense not to pre-wire the actions in the system, but let them be learned by experience. In our model, we explicitly do not include a known set of movements. Instead, motor actions are labeled “M1” and “M2” on purpose; only by means of sensorimotor experience, associations are learned between feature codes and motor codes, allowing the model to represent its own actions in terms of the perceived action effects. The model can subsequently plan a motor action by anticipating (i.e., activating the feature codes corresponding to) these perceptual effects (see also the subsection on anticipation). The theme of ideomotor learning is already quite popular in the robotics literature (for an overview, see Pezzulo et al. <xref ref-type="bibr" rid="CR28">2006</xref>
). Note that in our current implementation, we assume the existence of distal feature codes and let the model learn connections between these feature codes and motor codes, rather than between sensory codes and motor codes directly. We envision that this generalization renders the acquired ideomotor associations applicable to a variety of circumstances (i.e., generalizing over objects and over actions). In addition, ideomotor learning is modulated by the current task and attentional resources, as described in the next subsection.</p>
</sec>
<sec id="Sec20"><title>Task context and attention</title>
<p>The second aspect is the influence of task context and attention on both perception and action. As is demonstrated in Simulation 1, internalization of the task instruction not only specifies the stimulus-response mappings that determine the perception-cognition-action information flow from stimulus to response, but also influences the interactions between perception and action (see next subsection). Codes that are relevant for stimulus perception and/or action planning are top-down enhanced. Different task contexts may weigh different dimensions and features differently and consequently speed up the stimulus-response translation process in a way that suits the task best. Attention is studied quite extensively in cognitive robotics and is key in active perception strategies (e.g., Ognibene et al. <xref ref-type="bibr" rid="CR27">2008</xref>
).</p>
<p>In HiTEC, feature codes belonging to objects can be enhanced in activation (in other words: attended to), as can be features belonging to action effects (in other words: intended or effect anticipation). Thus, as demonstrated by Simulation 1, task context can make the system “pay attention” to those action effects that are important to the task while attenuating the influence of irrelevant additional effects. This processing aspect is crucial when learning (both in sensorimotor and ideomotor learning) in a complex environment. As cognitive robots are typically able to track a wealth of sensor readings, it can be hard to determine which action effects are particularly relevant for learning (see also the frame problem in artificial intelligence, Russell and Norvig <xref ref-type="bibr" rid="CR33">1995</xref>
; Dennett <xref ref-type="bibr" rid="CR6">1984</xref>
). The selective attention for elements of the important action effects still relies on the context such as the task at hand or on a system that uses internal drives (e.g., Cos-Aguilera et al. <xref ref-type="bibr" rid="CR4">2004</xref>
), but the weighting of action effect features may present an elegant way for a robot system to specifically monitor its anticipated action results.</p>
<p>Also, actions are selected based on perceived object features—following the task level connections—and the attention for specific features or feature dimensions applied to both object perception and action planning. As a consequence, the model does not select actions for a particular object in a reflex-like manner, but it takes the current task into account, both in object perception and response selection (see also Hommel <xref ref-type="bibr" rid="CR16">2000</xref>
).</p>
<p>It is important to note that our conception of “task” is extremely simplified and only relates to the current stimulus to response translation rules, neglecting the human capacity of planning action sequences or even performing multiple tasks simultaneously (e.g., as modeled in EPIC, Kieras and Meyer <xref ref-type="bibr" rid="CR20">1997</xref>
). However, HiTECs task could be part of a broader definition of task, including sequences of actions and criteria for determining whether a task has ended (see also Pezzulo et al. <xref ref-type="bibr" rid="CR28">2006</xref>
for a conceptual analysis of ideomotor learning and a task-oriented model such as TOTE).</p>
</sec>
<sec id="Sec21"><title>Interaction between perception and action</title>
<p>The third aspect is the interaction between perception and action planning as a result of the common coding principle (Hommel et al. <xref ref-type="bibr" rid="CR18">2001</xref>
). Feature codes that are used to cognitively represent stimulus features (e.g., object location, intensity) are also used to represent action features. As a result, stimulus-response compatibility effects can arise, such as the Simon effect that we replicated in Simulation 2: when a feature code activated by the stimulus is also part of the features belonging to the correct response, planning this response is facilitated, yielding faster reactions. If, on the other hand, the feature code activated by the stimulus is part of the incorrect response, this increases the competition between the alternative responses, resulting in slower reactions. It may appear that this effect is due to information processing from stimulus to response only. However, following the HiTEC logic, the stimulus location only has an effect because location is relevant for the action. Thus, action planning influences object perception. Moreover, while attention plays a role in “tagging” codes to be of importance (whether it is for stimulus perception or for action planning), the actual information flow from stimulus to response (effect) is rather automatic, in a sense bypassing the “cognitive” stage. In robotics, one could envision that perceiving an object shape already enhances the planning of a roughly equivalent hand shape. In our model, this is done on a distal level. That is, a ball-park type of “equivalent” shape is anticipated. During a reaching movement, the precise hand shape can be adjusted to the precise shape of the object to be grasped. Of course, how this is realized exactly should be subject to further research. Still, the automatic translation from perceived object features to anticipated action features seems a promising characteristic with respect to the notion of affordance (see last subsection).</p>
</sec>
<sec id="Sec22"><title>Anticipation</title>
<p>Numerous cognitive robotics projects include a notion of “anticipation” (see Pezzulo et al. <xref ref-type="bibr" rid="CR29">2008</xref>
for an overview). This is crucial, because in action planning and control it seems difficult to evaluate all potential variations in advance, as real data can vary a lot and the behavior of the environment is not always completely controlled by the robot. Thus, it seems intuitive to form anticipations on a distal level. In HiTEC, we adhere to an explicit notion of anticipation using distal feature codes. Activating these codes not only helps in action selection or planning, rather it is how actions are selected and planned in HiTEC. Following the ideomotor principle, the anticipated action effect activates the associated motor action resulting in actual action execution. However, how, the action subsequently unfolds is not explicitly modeled. By comparing the anticipated effects with the actually perceived effects, the system can determine whether the action was successful. If there is a discrepancy between the anticipated and perceived action effect, the model can update its representations to learn new action effects or fine-tune action control (see for more details Haazebroek and Hommel <xref ref-type="bibr" rid="CR13">2009</xref>
).</p>
<p>Finally, as described in previous subsections, the system focuses attention on those features that are important for the current task context, both in object perception and in action effect perception. Thus, the task context determines which effect features are especially monitored. This process may present opportunities to tackle the frame problem in artificial intelligence (Russell and Norvig <xref ref-type="bibr" rid="CR33">1995</xref>
; Dennett <xref ref-type="bibr" rid="CR6">1984</xref>
).</p>
</sec>
<sec id="Sec23"><title>Affordances</title>
<p>Roboticists have started to embrace the notion of affordance (after Gibson <xref ref-type="bibr" rid="CR12">1979</xref>
) in their robot architectures. For example, Montesano et al. (<xref ref-type="bibr" rid="CR24">2008</xref>
) define affordances as links between objects, actions, and effects. It is commonly assumed that such links are acquired during experience. Typical setups consist of an exploration phase in which actions are executed randomly and action success is determined. Then, object features are correlated with actions and their success. Finally, for each action, it is determined which object features are good indications for their successful execution yielding a set of affordances in terms of stimulus features—motor actions (S-R) reflexes.</p>
<p>In our model, the notion of affordance is effectively realized by allowing for automatic translation of perceptual object features (e.g., object shape) to action by means of overlap with anticipated action effect features (e.g., hand shape). In this sense, feature codes are representations of regularities encountered in sensorimotor experience. By focusing attention on certain action plan features, these dimensions also become enhanced in object perception. As a consequence, these sensory features are processed more strongly than others. Thus, rather than defining affordances as successful, yet arbitrary, S-R reflexes, we define an affordance in terms of intrinsic overlap between stimulus features and action effect features as encountered in sensorimotor experience. Indeed, by having common codes, perceiving objects fundamentally implies anticipating intrinsically related action plan features. Because of the ideomotor links, activating features shared by objects and actions, the system is easily biased to plan and execute appropriate motor actions. Crucially, the task determines which (object and action) features are relevant and therefore which affordances apply.</p>
</sec>
</sec>
<sec id="Sec24"><title>Conclusion</title>
<p>We have shown how the HiTEC model can readily replicate key findings from the perception–action literature using simulations. These simulations demonstrate three main processing aspects that seem relevant for cognitive robots as they intimately relate to crucial themes as anticipation and affordances.</p>
<p>It is clear that HiTEC is still limited to simulations of basic, yet fundamental phenomena in the perception–action domain. Our main objective was to develop an architecture that gives an integrated processing account of the interaction between perception and action. However, we envision that the model could be extended with a variety of capabilities, such as higher fidelity perception and motor action, as well as episodic and semantic memory capacities. This way, HiTEC could become a more mature cognitive architecture (Byrne <xref ref-type="bibr" rid="CR2">2008</xref>
).</p>
<p>Other extensions may include the processing of affective information. In reinforcement learning approaches, affective information is usually treated as additional information that co-defines the desirability of a state (i.e., as a “reward”) or action alternative (i.e., as part of its “value” or “utility”). By weighting action alternatives with this information (see also the notion of somatic markers, Damasio <xref ref-type="bibr" rid="CR5">1994</xref>
), some can turn out to be more desirable than others, which can aid the process of decision making (e.g., Broekens and Haazebroek <xref ref-type="bibr" rid="CR1">2007</xref>
). In psychological research, studies have shown affective stimulus-response compatibility effects (e.g., Chen and Bargh <xref ref-type="bibr" rid="CR3">1999</xref>
; van Dantzig et al. <xref ref-type="bibr" rid="CR37">2008</xref>
). Participants are typically faster to respond to positive stimuli (e.g., the word “love”, a picture of a smiling face) when they perform an approach movement than an avoidance movement. Conversely, they are faster to respond to negative stimuli (e.g., the word “war”, a picture of a spider) when performing an avoidance movement than an approach movement. These findings are taken as evidence that affective stimuli automatically activate action tendencies related to approach and avoidance (e.g., Chen and Bargh <xref ref-type="bibr" rid="CR3">1999</xref>
). Elsewhere (Haazebroek et al. <xref ref-type="bibr" rid="CR14">2009</xref>
), we have shown how HiTEC can already account for such affective stimulus-response compatibility effects.</p>
<p>Still, HiTEC has not yet been implemented on an actual robot platform, which would require substantial implementation effort concerning the grounding of sensory input and motor output. However, it would also provide a wealth of opportunities to study and test HiTEC’s processing aspects in real-world scenarios.</p>
</sec>
</body>
<back><ack><p>Our thanks go to Antonino Raffone who was instrumental in the implementation of HiTEC and in conducting our simulations. Support for this research by the European Commission (PACO-PLUS, IST-FP6-IP-027657) is gratefully acknowledged.</p>
<p><bold>Open Access</bold>
This article is distributed under the terms of the Creative Commons Attribution Noncommercial License which permits any noncommercial use, distribution, and reproduction in any medium, provided the original author(s) and source are credited.</p>
</ack>
<ref-list id="Bib1"><title>References</title>
<ref id="CR1"><mixed-citation publication-type="other">Broekens J, Haazebroek P (2007) Emotion and reinforcement: affective facial expressions facilitate robot learning. In: Proceedings of the IJCAI workshop on AI for human computing (AI4HC’07), pp 47–54</mixed-citation>
</ref>
<ref id="CR2"><mixed-citation publication-type="book"><person-group person-group-type="author"><name><surname>Byrne</surname>
<given-names>MD</given-names>
</name>
</person-group>
<person-group person-group-type="editor"><name><surname>Jacko</surname>
<given-names>JA</given-names>
</name>
<name><surname>Sears</surname>
<given-names>A</given-names>
</name>
</person-group>
<article-title>Cognitive architecture</article-title>
<source>Human-computer interaction handbook</source>
<year>2008</year>
<publisher-loc>Mahwah</publisher-loc>
<publisher-name>Erlbaum</publisher-name>
<fpage>97</fpage>
<lpage>117</lpage>
</mixed-citation>
</ref>
<ref id="CR3"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Chen</surname>
<given-names>S</given-names>
</name>
<name><surname>Bargh</surname>
<given-names>JA</given-names>
</name>
</person-group>
<article-title>Consequences of automatic evaluation: immediate behavior predispositions to approach or avoid the stimulus</article-title>
<source>Pers Soc Psychol Bull</source>
<year>1999</year>
<volume>25</volume>
<fpage>215</fpage>
<lpage>224</lpage>
<pub-id pub-id-type="doi">10.1177/0146167299025002007</pub-id>
</mixed-citation>
</ref>
<ref id="CR4"><mixed-citation publication-type="other">Cos-Aguilera I, Hayes G, Canamero L (2004) Using a SOFM to learn object affordances. In: Proceedings of the 5th workshop of physical agents (WAF 04)</mixed-citation>
</ref>
<ref id="CR5"><mixed-citation publication-type="book"><person-group person-group-type="author"><name><surname>Damasio</surname>
<given-names>AR</given-names>
</name>
</person-group>
<source>Descartes’ error</source>
<year>1994</year>
<publisher-loc>New York</publisher-loc>
<publisher-name>G. P. Putnam’s Sons</publisher-name>
</mixed-citation>
</ref>
<ref id="CR6"><mixed-citation publication-type="book"><person-group person-group-type="author"><name><surname>Dennett</surname>
<given-names>DC</given-names>
</name>
</person-group>
<person-group person-group-type="editor"><name><surname>Hookaway</surname>
<given-names>C</given-names>
</name>
</person-group>
<article-title>Cognitive wheels: the frame problem of AI</article-title>
<source>Minds, machines and evolution</source>
<year>1984</year>
<publisher-loc>Cambridge</publisher-loc>
<publisher-name>Cambridge University Press</publisher-name>
<fpage>129</fpage>
<lpage>151</lpage>
</mixed-citation>
</ref>
<ref id="CR7"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>DeYoe</surname>
<given-names>EA</given-names>
</name>
<name><surname>Essen</surname>
<given-names>DC</given-names>
</name>
</person-group>
<article-title>Concurrent processing streams in monkey visual cortex</article-title>
<source>Trend Neurosci</source>
<year>1988</year>
<volume>11</volume>
<fpage>219</fpage>
<lpage>226</lpage>
<pub-id pub-id-type="doi">10.1016/0166-2236(88)90130-0</pub-id>
<pub-id pub-id-type="pmid">2471327</pub-id>
</mixed-citation>
</ref>
<ref id="CR8"><mixed-citation publication-type="other">Donders FC (1868) Over de snelheid van psychische processen. Onderzoekingen, gedaan in het physiologisch laboratorium der Utrechtsche hoogeschool, 2. Reeks 2:92–120</mixed-citation>
</ref>
<ref id="CR9"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Elsner</surname>
<given-names>B</given-names>
</name>
<name><surname>Hommel</surname>
<given-names>B</given-names>
</name>
</person-group>
<article-title>Effect anticipation and action control</article-title>
<source>J Exp Psychol Hum Percept Perform</source>
<year>2001</year>
<volume>27</volume>
<fpage>229</fpage>
<lpage>240</lpage>
<pub-id pub-id-type="doi">10.1037/0096-1523.27.1.229</pub-id>
<pub-id pub-id-type="pmid">11248937</pub-id>
</mixed-citation>
</ref>
<ref id="CR10"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Fagioli</surname>
<given-names>S</given-names>
</name>
<name><surname>Hommel</surname>
<given-names>B</given-names>
</name>
<name><surname>Schubotz</surname>
<given-names>RI</given-names>
</name>
</person-group>
<article-title>Intentional control of attention: action planning primes action-related stimulus dimensions</article-title>
<source>Psychol Res</source>
<year>2007</year>
<volume>71</volume>
<fpage>22</fpage>
<lpage>29</lpage>
<pub-id pub-id-type="doi">10.1007/s00426-005-0033-3</pub-id>
<pub-id pub-id-type="pmid">16317565</pub-id>
</mixed-citation>
</ref>
<ref id="CR11"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Fitzpatrick</surname>
<given-names>P</given-names>
</name>
<name><surname>Metta</surname>
<given-names>G</given-names>
</name>
</person-group>
<article-title>Grounding vision through experimental manipulation</article-title>
<source>Philos Transact A Math Phys Eng Sci</source>
<year>2003</year>
<volume>361</volume>
<fpage>2165</fpage>
<lpage>2185</lpage>
<pub-id pub-id-type="doi">10.1098/rsta.2003.1251</pub-id>
<pub-id pub-id-type="pmid">14599314</pub-id>
</mixed-citation>
</ref>
<ref id="CR12"><mixed-citation publication-type="book"><person-group person-group-type="author"><name><surname>Gibson</surname>
<given-names>JJ</given-names>
</name>
</person-group>
<source>The ecological approach to visual perception</source>
<year>1979</year>
<publisher-loc>Boston</publisher-loc>
<publisher-name>Houghton Mifflin</publisher-name>
</mixed-citation>
</ref>
<ref id="CR13"><mixed-citation publication-type="other">Haazebroek P, Hommel B (2009) Anticipative control of voluntary action: towards a computational model. In Pezzulo G, Butz MV, Sigaud O, Baldassarre G (eds) Anticipatory behavior in adaptive learning systems: from psychological theories to artificial cognitive systems. Lecture Notes in Artifical Intelligence, vol 5499, pp 31–47</mixed-citation>
</ref>
<ref id="CR14"><mixed-citation publication-type="other">Haazebroek P, van Dantzig S, Hommel B (2009). Towards a computational account of context mediated affective stimulus-response translation. In: Proceedings of the 31st annual conference of the cognitive science society. Cognitive Science Society, Austin, TX</mixed-citation>
</ref>
<ref id="CR40"><mixed-citation publication-type="other">Haazebroek P, Raffone A, Hommel B (submitted). HiTEC: a computation model of the interaction between perception and action planning</mixed-citation>
</ref>
<ref id="CR15"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Hoffmann</surname>
<given-names>H</given-names>
</name>
</person-group>
<article-title>Perception through visuomotor anticipation in a mobile robot</article-title>
<source>Neural Netw</source>
<year>2007</year>
<volume>20</volume>
<fpage>22</fpage>
<lpage>33</lpage>
<pub-id pub-id-type="doi">10.1016/j.neunet.2006.07.003</pub-id>
<pub-id pub-id-type="pmid">17010571</pub-id>
</mixed-citation>
</ref>
<ref id="CR16"><mixed-citation publication-type="book"><person-group person-group-type="author"><name><surname>Hommel</surname>
<given-names>B</given-names>
</name>
</person-group>
<person-group person-group-type="editor"><name><surname>Monsell</surname>
<given-names>S</given-names>
</name>
<name><surname>Driver</surname>
<given-names>J</given-names>
</name>
</person-group>
<article-title>The prepared reflex: automaticity and control in stimulus-response translation</article-title>
<source>Control of cognitive processes: attention and performance XVIII</source>
<year>2000</year>
<publisher-loc>Cambridge</publisher-loc>
<publisher-name>MIT Press</publisher-name>
<fpage>247</fpage>
<lpage>273</lpage>
</mixed-citation>
</ref>
<ref id="CR17"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Hommel</surname>
<given-names>B</given-names>
</name>
</person-group>
<article-title>Action control according to TEC (theory of event coding)</article-title>
<source>Psychol Res</source>
<year>2009</year>
<volume>73</volume>
<fpage>512</fpage>
<lpage>526</lpage>
<pub-id pub-id-type="doi">10.1007/s00426-009-0234-2</pub-id>
<pub-id pub-id-type="pmid">19337749</pub-id>
</mixed-citation>
</ref>
<ref id="CR18"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Hommel</surname>
<given-names>B</given-names>
</name>
<name><surname>Müsseler</surname>
<given-names>J</given-names>
</name>
<name><surname>Aschersleben</surname>
<given-names>G</given-names>
</name>
<name><surname>Prinz</surname>
<given-names>W</given-names>
</name>
</person-group>
<article-title>The theory of event coding (TEC): a framework for perception and action planning</article-title>
<source>Behav Brain Sci</source>
<year>2001</year>
<volume>24</volume>
<fpage>849</fpage>
<lpage>937</lpage>
<pub-id pub-id-type="doi">10.1017/S0140525X01000103</pub-id>
<pub-id pub-id-type="pmid">12239891</pub-id>
</mixed-citation>
</ref>
<ref id="CR19"><mixed-citation publication-type="book"><person-group person-group-type="author"><name><surname>James</surname>
<given-names>W</given-names>
</name>
</person-group>
<source>The principles of psychology</source>
<year>1890</year>
<publisher-loc>New York</publisher-loc>
<publisher-name>Dover Publications</publisher-name>
</mixed-citation>
</ref>
<ref id="CR20"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Kieras</surname>
<given-names>DE</given-names>
</name>
<name><surname>Meyer</surname>
<given-names>DE</given-names>
</name>
</person-group>
<article-title>An overview of the EPIC architecture for cognition and performance with application to human-computer interaction</article-title>
<source>Hum Comput Interact</source>
<year>1997</year>
<volume>12</volume>
<fpage>391</fpage>
<lpage>438</lpage>
<pub-id pub-id-type="doi">10.1207/s15327051hci1204_4</pub-id>
</mixed-citation>
</ref>
<ref id="CR21"><mixed-citation publication-type="other">Kraft D, Pugeault N, Baseski E, Popovic M, Kragic D, Kalkan S et al. (2008) Birth of the object: detection of objectness and extraction of object shape through object- action complexes. Int J HR 5:247–265</mixed-citation>
</ref>
<ref id="CR22"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Kunde</surname>
<given-names>W</given-names>
</name>
<name><surname>Koch</surname>
<given-names>I</given-names>
</name>
<name><surname>Hoffmann</surname>
<given-names>J</given-names>
</name>
</person-group>
<article-title>Anticipated action effects affect the selection, initiation, and execution of actions</article-title>
<source>Q J Exp Psychol A</source>
<year>2004</year>
<volume>57</volume>
<fpage>87</fpage>
<lpage>106</lpage>
<pub-id pub-id-type="doi">10.1080/02724980343000143</pub-id>
<pub-id pub-id-type="pmid">14681005</pub-id>
</mixed-citation>
</ref>
<ref id="CR23"><mixed-citation publication-type="other">Lacroix JPW, Postma EO, Hommel B, Haazebroek P (2006) NIM as a brain for a humanoid robot. In: Proceedings of the toward cognitive humanoid robots workshop at the IEEE-RAS international conference on humanoid robots 2006. Genoa, Italy</mixed-citation>
</ref>
<ref id="CR24"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Montesano</surname>
<given-names>L</given-names>
</name>
<name><surname>Lopes</surname>
<given-names>M</given-names>
</name>
<name><surname>Bernardino</surname>
<given-names>A</given-names>
</name>
<name><surname>Santos-Victor</surname>
<given-names>J</given-names>
</name>
</person-group>
<article-title>Learning object affordances: from sensory motor coordination to imitation</article-title>
<source>IEEE Trans Robot</source>
<year>2008</year>
<volume>24</volume>
<fpage>15</fpage>
<lpage>26</lpage>
<pub-id pub-id-type="doi">10.1109/TRO.2007.914848</pub-id>
</mixed-citation>
</ref>
<ref id="CR25"><mixed-citation publication-type="other">Neisser U (1967) Cognitive psychology appleton-century-crofts. New York</mixed-citation>
</ref>
<ref id="CR26"><mixed-citation publication-type="book"><person-group person-group-type="author"><name><surname>Norman</surname>
<given-names>DA</given-names>
</name>
</person-group>
<source>The design of everyday things</source>
<year>1988</year>
<publisher-loc>New York</publisher-loc>
<publisher-name>Basic Book</publisher-name>
</mixed-citation>
</ref>
<ref id="CR27"><mixed-citation publication-type="other">Ognibene D, Balkenius C, Baldasarre G (2008) Integrating epistemic action (active vision) and pragmatic action (reaching): a neural architecture for camera-arm robots. In: Minoru A, Hallam JCT, Mayer J-A, Tani J (eds) From animals to animats 10</mixed-citation>
</ref>
<ref id="CR28"><mixed-citation publication-type="other">Pezzulo G, Baldassarre G, Butz MV, Castelfranchi C, Hoffmann J (2006) An analysis of the ideomotor principle and TOTE. In: Butz MV, Sigaud O, Pezzulo G, Baldassarre G (eds) Anticipatory behavior in adaptive learning systems: advances in anticipatory processing. Springer LNAI 4520, pp 73–93</mixed-citation>
</ref>
<ref id="CR29"><mixed-citation publication-type="other">Pezzulo G, Butz MV, Castelfranchi C (2008) The anticipatory approach: definitions and taxonomies. In: Pezzulo G, Butz MV, Castelfranchi C, Falcone R (eds) The challenge of anticipation: a unifying framework for the analysis and design of artificial cognitive systems. Springer LNAI 5225, pp 23–43</mixed-citation>
</ref>
<ref id="CR30"><mixed-citation publication-type="book"><person-group person-group-type="author"><name><surname>Prinz</surname>
<given-names>W</given-names>
</name>
</person-group>
<person-group person-group-type="editor"><name><surname>Neumann</surname>
<given-names>O</given-names>
</name>
<name><surname>Prinz</surname>
<given-names>W</given-names>
</name>
</person-group>
<article-title>A common coding approach to perception and action</article-title>
<source>Relationships between perception and action</source>
<year>1990</year>
<publisher-loc>Berlin</publisher-loc>
<publisher-name>Springer Verlag</publisher-name>
<fpage>167</fpage>
<lpage>201</lpage>
</mixed-citation>
</ref>
<ref id="CR31"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Rizzolatti</surname>
<given-names>G</given-names>
</name>
<name><surname>Craighero</surname>
<given-names>L</given-names>
</name>
</person-group>
<article-title>The mirror-neuron system</article-title>
<source>Annu Rev Neurosci</source>
<year>2004</year>
<volume>27</volume>
<fpage>169</fpage>
<lpage>192</lpage>
<pub-id pub-id-type="doi">10.1146/annurev.neuro.27.070203.144230</pub-id>
<pub-id pub-id-type="pmid">15217330</pub-id>
</mixed-citation>
</ref>
<ref id="CR32"><mixed-citation publication-type="book"><person-group person-group-type="author"><name><surname>Rumelhart</surname>
<given-names>DE</given-names>
</name>
<name><surname>Hinton</surname>
<given-names>GE</given-names>
</name>
<name><surname>McClelland</surname>
<given-names>JL</given-names>
</name>
</person-group>
<person-group person-group-type="editor"><name><surname>Rumelhart</surname>
<given-names>DE</given-names>
</name>
<name><surname>McClelland</surname>
<given-names>JL</given-names>
</name>
</person-group>
<article-title>A general framework for parallel distributed processing</article-title>
<source>Parallel distributed processing: explorations in the microstructure of cognition</source>
<year>1986</year>
<publisher-loc>Cambridge, MA</publisher-loc>
<publisher-name>MIT Press</publisher-name>
<fpage>45</fpage>
<lpage>76</lpage>
</mixed-citation>
</ref>
<ref id="CR33"><mixed-citation publication-type="book"><person-group person-group-type="author"><name><surname>Russell</surname>
<given-names>S</given-names>
</name>
<name><surname>Norvig</surname>
<given-names>P</given-names>
</name>
</person-group>
<source>Artificial intelligence: a modern approach</source>
<year>1995</year>
<publisher-loc>NJ</publisher-loc>
<publisher-name>Prentice Hall</publisher-name>
</mixed-citation>
</ref>
<ref id="CR34"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Simon</surname>
<given-names>JR</given-names>
</name>
<name><surname>Rudell</surname>
<given-names>AP</given-names>
</name>
</person-group>
<article-title>Auditory S-R compatibility: the effect of an irrelevant cue on information processing</article-title>
<source>J Appl Psychol</source>
<year>1967</year>
<volume>51</volume>
<fpage>300</fpage>
<lpage>304</lpage>
<pub-id pub-id-type="doi">10.1037/h0020586</pub-id>
<pub-id pub-id-type="pmid">6045637</pub-id>
</mixed-citation>
</ref>
<ref id="CR35"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Stock</surname>
<given-names>A</given-names>
</name>
<name><surname>Stock</surname>
<given-names>C</given-names>
</name>
</person-group>
<article-title>A short history of ideo-motor action</article-title>
<source>Psychol Res</source>
<year>2004</year>
<volume>68</volume>
<fpage>176</fpage>
<lpage>188</lpage>
<pub-id pub-id-type="doi">10.1007/s00426-003-0154-5</pub-id>
<pub-id pub-id-type="pmid">14685855</pub-id>
</mixed-citation>
</ref>
<ref id="CR36"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Uğur</surname>
<given-names>E</given-names>
</name>
<name><surname>Şahin</surname>
<given-names>E</given-names>
</name>
</person-group>
<article-title>Traversability: a case study for learning and perceiving affordances in robots</article-title>
<source>Adaptive Behavior</source>
<year>2010</year>
<volume>18</volume>
<fpage>258</fpage>
<lpage>284</lpage>
<pub-id pub-id-type="doi">10.1177/1059712310370625</pub-id>
</mixed-citation>
</ref>
<ref id="CR37"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Dantzig</surname>
<given-names>S</given-names>
</name>
<name><surname>Pecher</surname>
<given-names>D</given-names>
</name>
<name><surname>Zwaan</surname>
<given-names>RA</given-names>
</name>
</person-group>
<article-title>Approach and avoidance as action effects</article-title>
<source>Q J Exp Psychol</source>
<year>2008</year>
<volume>61</volume>
<fpage>1298</fpage>
<lpage>1306</lpage>
<pub-id pub-id-type="doi">10.1080/17470210802027987</pub-id>
</mixed-citation>
</ref>
<ref id="CR38"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Wörgötter</surname>
<given-names>F</given-names>
</name>
<name><surname>Agostini</surname>
<given-names>A</given-names>
</name>
<name><surname>Krüger</surname>
<given-names>N</given-names>
</name>
<name><surname>Shylo</surname>
<given-names>N</given-names>
</name>
<name><surname>Porr</surname>
<given-names>B</given-names>
</name>
</person-group>
<article-title>Cognitive agents—a procedural perspective relying on the predictability of Object-Action-Complexes (OACs)</article-title>
<source>Rob Auton Syst</source>
<year>2009</year>
<volume>57</volume>
<fpage>420</fpage>
<lpage>432</lpage>
<pub-id pub-id-type="doi">10.1016/j.robot.2008.06.011</pub-id>
</mixed-citation>
</ref>
<ref id="CR39"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Wykowska</surname>
<given-names>A</given-names>
</name>
<name><surname>Schubö</surname>
<given-names>A</given-names>
</name>
<name><surname>Hommel</surname>
<given-names>B</given-names>
</name>
</person-group>
<article-title>How you move is what you see: action planning biases selection in visual search</article-title>
<source>J Exp Psychol Hum Percept Perform</source>
<year>2009</year>
<volume>35</volume>
<fpage>1755</fpage>
<lpage>1769</lpage>
<pub-id pub-id-type="doi">10.1037/a0016798</pub-id>
<pub-id pub-id-type="pmid">19968433</pub-id>
</mixed-citation>
</ref>
<ref id="CR41"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Ziemke</surname>
<given-names>T</given-names>
</name>
<name><surname>Jirenhed</surname>
<given-names>D-A</given-names>
</name>
<name><surname>Hesslow</surname>
<given-names>G</given-names>
</name>
</person-group>
<article-title>Internal simulation of perception: a minimal neuro-robotic model</article-title>
<source>Neurocomputing</source>
<year>2005</year>
<volume>68</volume>
<fpage>85</fpage>
<lpage>104</lpage>
<pub-id pub-id-type="doi">10.1016/j.neucom.2004.12.005</pub-id>
</mixed-citation>
</ref>
</ref-list>
</back>
</pmc>
</record>
Pour manipuler ce document sous Unix (Dilib)
EXPLOR_STEP=$WICRI_ROOT/Ticri/CIDE/explor/HapticV1/Data/Pmc/Curation
HfdSelect -h $EXPLOR_STEP/biblio.hfd -nk 000670 | SxmlIndent | more
Ou
HfdSelect -h $EXPLOR_AREA/Data/Pmc/Curation/biblio.hfd -nk 000670 | SxmlIndent | more
Pour mettre un lien sur cette page dans le réseau Wicri
{{Explor lien |wiki= Ticri/CIDE |area= HapticV1 |flux= Pmc |étape= Curation |type= RBID |clé= PMC:3206188 |texte= A computational model of perception and action for cognitive robotics }}
Pour générer des pages wiki
HfdIndexSelect -h $EXPLOR_AREA/Data/Pmc/Curation/RBID.i -Sk "pubmed:21597926" \ | HfdSelect -Kh $EXPLOR_AREA/Data/Pmc/Curation/biblio.hfd \ | NlmPubMed2Wicri -a HapticV1
![]() | This area was generated with Dilib version V0.6.23. | ![]() |