Sensory prediction on a whiskered robot: a tactile analogy to “optical flow”
Identifieur interne : 002304 ( Ncbi/Merge ); précédent : 002303; suivant : 002305Sensory prediction on a whiskered robot: a tactile analogy to “optical flow”
Auteurs : Christopher L. Schroeder [États-Unis] ; Mitra J. Z. Hartmann [États-Unis]Source :
- Frontiers in Neurorobotics [ 1662-5218 ] ; 2012.
Abstract
When an animal moves an array of sensors (e.g., the hand, the eye) through the environment, spatial and temporal gradients of sensory data are related by the velocity of the moving sensory array. In vision, the relationship between spatial and temporal brightness gradients is quantified in the “optical flow” equation. In the present work, we suggest an analog to optical flow for the rodent vibrissal (whisker) array, in which the perceptual intensity that “flows” over the array is bending moment. Changes in bending moment are directly related to radial object distance, defined as the distance between the base of a whisker and the point of contact with the object. Using both simulations and a 1×5 array (row) of artificial whiskers, we demonstrate that local object curvature can be estimated based on differences in radial distance across the array. We then develop two algorithms, both based on tactile flow, to predict the future contact points that will be obtained as the whisker array translates along the object. The translation of the robotic whisker array represents the rat's head velocity. The first algorithm uses a calculation of the local object slope, while the second uses a calculation of the local object curvature. Both algorithms successfully predict future contact points for simple surfaces. The algorithm based on curvature was found to more accurately predict future contact points as surfaces became more irregular. We quantify the inter-related effects of whisker spacing and the object's spatial frequencies, and examine the issues that arise in the presence of real-world noise, friction, and slip.
Url:
DOI: 10.3389/fnbot.2012.00009
PubMed: 23097641
PubMed Central: 3477675
Links toward previous steps (curation, corpus...)
- to stream Pmc, to step Corpus: 001E34
- to stream Pmc, to step Curation: 001E34
- to stream Pmc, to step Checkpoint: 001573
Links to Exploration step
PMC:3477675Le document en format XML
<record><TEI><teiHeader><fileDesc><titleStmt><title xml:lang="en">Sensory prediction on a whiskered robot: a tactile analogy to “optical flow”</title>
<author><name sortKey="Schroeder, Christopher L" sort="Schroeder, Christopher L" uniqKey="Schroeder C" first="Christopher L." last="Schroeder">Christopher L. Schroeder</name>
<affiliation wicri:level="1"><nlm:aff id="aff1"><institution>Department of Biomedical Engineering, Northwestern University</institution>
<country>Evanston, IL, USA</country>
</nlm:aff>
<country xml:lang="fr">États-Unis</country>
<wicri:regionArea></wicri:regionArea>
<wicri:regionArea># see nlm:aff region in country</wicri:regionArea>
</affiliation>
</author>
<author><name sortKey="Hartmann, Mitra J Z" sort="Hartmann, Mitra J Z" uniqKey="Hartmann M" first="Mitra J. Z." last="Hartmann">Mitra J. Z. Hartmann</name>
<affiliation wicri:level="1"><nlm:aff id="aff1"><institution>Department of Biomedical Engineering, Northwestern University</institution>
<country>Evanston, IL, USA</country>
</nlm:aff>
<country xml:lang="fr">États-Unis</country>
<wicri:regionArea></wicri:regionArea>
<wicri:regionArea># see nlm:aff region in country</wicri:regionArea>
</affiliation>
<affiliation wicri:level="1"><nlm:aff id="aff2"><institution>Department of Mechanical Engineering, Northwestern University</institution>
<country>Evanston, IL, USA</country>
</nlm:aff>
<country xml:lang="fr">États-Unis</country>
<wicri:regionArea></wicri:regionArea>
<wicri:regionArea># see nlm:aff region in country</wicri:regionArea>
</affiliation>
</author>
</titleStmt>
<publicationStmt><idno type="wicri:source">PMC</idno>
<idno type="pmid">23097641</idno>
<idno type="pmc">3477675</idno>
<idno type="url">http://www.ncbi.nlm.nih.gov/pmc/articles/PMC3477675</idno>
<idno type="RBID">PMC:3477675</idno>
<idno type="doi">10.3389/fnbot.2012.00009</idno>
<date when="2012">2012</date>
<idno type="wicri:Area/Pmc/Corpus">001E34</idno>
<idno type="wicri:Area/Pmc/Curation">001E34</idno>
<idno type="wicri:Area/Pmc/Checkpoint">001573</idno>
<idno type="wicri:Area/Ncbi/Merge">002304</idno>
</publicationStmt>
<sourceDesc><biblStruct><analytic><title xml:lang="en" level="a" type="main">Sensory prediction on a whiskered robot: a tactile analogy to “optical flow”</title>
<author><name sortKey="Schroeder, Christopher L" sort="Schroeder, Christopher L" uniqKey="Schroeder C" first="Christopher L." last="Schroeder">Christopher L. Schroeder</name>
<affiliation wicri:level="1"><nlm:aff id="aff1"><institution>Department of Biomedical Engineering, Northwestern University</institution>
<country>Evanston, IL, USA</country>
</nlm:aff>
<country xml:lang="fr">États-Unis</country>
<wicri:regionArea></wicri:regionArea>
<wicri:regionArea># see nlm:aff region in country</wicri:regionArea>
</affiliation>
</author>
<author><name sortKey="Hartmann, Mitra J Z" sort="Hartmann, Mitra J Z" uniqKey="Hartmann M" first="Mitra J. Z." last="Hartmann">Mitra J. Z. Hartmann</name>
<affiliation wicri:level="1"><nlm:aff id="aff1"><institution>Department of Biomedical Engineering, Northwestern University</institution>
<country>Evanston, IL, USA</country>
</nlm:aff>
<country xml:lang="fr">États-Unis</country>
<wicri:regionArea></wicri:regionArea>
<wicri:regionArea># see nlm:aff region in country</wicri:regionArea>
</affiliation>
<affiliation wicri:level="1"><nlm:aff id="aff2"><institution>Department of Mechanical Engineering, Northwestern University</institution>
<country>Evanston, IL, USA</country>
</nlm:aff>
<country xml:lang="fr">États-Unis</country>
<wicri:regionArea></wicri:regionArea>
<wicri:regionArea># see nlm:aff region in country</wicri:regionArea>
</affiliation>
</author>
</analytic>
<series><title level="j">Frontiers in Neurorobotics</title>
<idno type="eISSN">1662-5218</idno>
<imprint><date when="2012">2012</date>
</imprint>
</series>
</biblStruct>
</sourceDesc>
</fileDesc>
<profileDesc><textClass></textClass>
</profileDesc>
</teiHeader>
<front><div type="abstract" xml:lang="en"><p>When an animal moves an array of sensors (e.g., the hand, the eye) through the environment, spatial and temporal gradients of sensory data are related by the velocity of the moving sensory array. In vision, the relationship between spatial and temporal brightness gradients is quantified in the “optical flow” equation. In the present work, we suggest an analog to optical flow for the rodent vibrissal (whisker) array, in which the perceptual intensity that “flows” over the array is bending moment. Changes in bending moment are directly related to radial object distance, defined as the distance between the base of a whisker and the point of contact with the object. Using both simulations and a 1×5 array (row) of artificial whiskers, we demonstrate that local object curvature can be estimated based on differences in radial distance across the array. We then develop two algorithms, both based on tactile flow, to predict the future contact points that will be obtained as the whisker array translates along the object. The translation of the robotic whisker array represents the rat's head velocity. The first algorithm uses a calculation of the local object slope, while the second uses a calculation of the local object curvature. Both algorithms successfully predict future contact points for simple surfaces. The algorithm based on curvature was found to more accurately predict future contact points as surfaces became more irregular. We quantify the inter-related effects of whisker spacing and the object's spatial frequencies, and examine the issues that arise in the presence of real-world noise, friction, and slip.</p>
</div>
</front>
<back><div1 type="bibliography"><listBibl><biblStruct><analytic><author><name sortKey="Barron, J L" uniqKey="Barron J">J. L. Barron</name>
</author>
<author><name sortKey="Fleet, D J" uniqKey="Fleet D">D. J. Fleet</name>
</author>
<author><name sortKey="Beauchemin, S S" uniqKey="Beauchemin S">S. S. Beauchemin</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Beauchemin, S S" uniqKey="Beauchemin S">S. S. Beauchemin</name>
</author>
<author><name sortKey="Barron, J L" uniqKey="Barron J">J. L. Barron</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Berg, R W" uniqKey="Berg R">R. W. Berg</name>
</author>
<author><name sortKey="Kleinfeld, D" uniqKey="Kleinfeld D">D. Kleinfeld</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Bicchi, A" uniqKey="Bicchi A">A. Bicchi</name>
</author>
<author><name sortKey="Scilingo, E P" uniqKey="Scilingo E">E. P. Scilingo</name>
</author>
<author><name sortKey="Ricciardi, E" uniqKey="Ricciardi E">E. Ricciardi</name>
</author>
<author><name sortKey="Pietrini, P" uniqKey="Pietrini P">P. Pietrini</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Birdwell, J A" uniqKey="Birdwell J">J. A. Birdwell</name>
</author>
<author><name sortKey="Solomon, J H" uniqKey="Solomon J">J. H. Solomon</name>
</author>
<author><name sortKey="Thajchayapong, M" uniqKey="Thajchayapong M">M. Thajchayapong</name>
</author>
<author><name sortKey="Taylor, M A" uniqKey="Taylor M">M. A. Taylor</name>
</author>
<author><name sortKey="Cheely, M" uniqKey="Cheely M">M. Cheely</name>
</author>
<author><name sortKey="Towal, R B" uniqKey="Towal R">R. B. Towal</name>
</author>
<author><name sortKey="Conradt, J" uniqKey="Conradt J">J. Conradt</name>
</author>
<author><name sortKey="Hartmann, M J Z" uniqKey="Hartmann M">M. J. Z. Hartmann</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Gopal, V" uniqKey="Gopal V">V. Gopal</name>
</author>
<author><name sortKey="Hartmann, M J Z" uniqKey="Hartmann M">M. J. Z. Hartmann</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Hartmann, M J Z" uniqKey="Hartmann M">M. J. Z. Hartmann</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Horn, B K P" uniqKey="Horn B">B. K. P. Horn</name>
</author>
<author><name sortKey="Schunck, B G" uniqKey="Schunck B">B. G. Schunck</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Kaneko, M" uniqKey="Kaneko M">M. Kaneko</name>
</author>
<author><name sortKey="Kanayama, N" uniqKey="Kanayama N">N. Kanayama</name>
</author>
<author><name sortKey="Tsuji, T" uniqKey="Tsuji T">T. Tsuji</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Munson, B R" uniqKey="Munson B">B. R. Munson</name>
</author>
<author><name sortKey="Young, D F" uniqKey="Young D">D. F. Young</name>
</author>
<author><name sortKey="Okiishi, T H" uniqKey="Okiishi T">T. H. Okiishi</name>
</author>
<author><name sortKey="Huebsch, W W" uniqKey="Huebsch W">W. W. Huebsch</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Nemenman, I" uniqKey="Nemenman I">I. Nemenman</name>
</author>
<author><name sortKey="Lewen, G D" uniqKey="Lewen G">G. D. Lewen</name>
</author>
<author><name sortKey="Bialek, W" uniqKey="Bialek W">W. Bialek</name>
</author>
<author><name sortKey="Van Steveninck, R R D" uniqKey="Van Steveninck R">R. R. D. Van Steveninck</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Scilingo, E P" uniqKey="Scilingo E">E. P. Scilingo</name>
</author>
<author><name sortKey="Sgambelluri, N" uniqKey="Sgambelluri N">N. Sgambelluri</name>
</author>
<author><name sortKey="Bicchi, A" uniqKey="Bicchi A">A. Bicchi</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Solomon, J H" uniqKey="Solomon J">J. H. Solomon</name>
</author>
<author><name sortKey="Hartmann, M J" uniqKey="Hartmann M">M. J. Hartmann</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Solomon, J H" uniqKey="Solomon J">J. H. Solomon</name>
</author>
<author><name sortKey="Hartmann, M J Z" uniqKey="Hartmann M">M. J. Z. Hartmann</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Solomon, J H" uniqKey="Solomon J">J. H. Solomon</name>
</author>
<author><name sortKey="Hartmann, M J Z" uniqKey="Hartmann M">M. J. Z. Hartmann</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Solomon, J H" uniqKey="Solomon J">J. H. Solomon</name>
</author>
<author><name sortKey="Hartmann, M J Z" uniqKey="Hartmann M">M. J. Z. Hartmann</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Szwed, M" uniqKey="Szwed M">M. Szwed</name>
</author>
<author><name sortKey="Bagdasarian, K" uniqKey="Bagdasarian K">K. Bagdasarian</name>
</author>
<author><name sortKey="Ahissar, E" uniqKey="Ahissar E">E. Ahissar</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Welker, W I" uniqKey="Welker W">W. I. Welker</name>
</author>
</analytic>
</biblStruct>
<biblStruct><analytic><author><name sortKey="Williams, C M" uniqKey="Williams C">C. M. Williams</name>
</author>
<author><name sortKey="Kramer, E M" uniqKey="Kramer E">E. M. Kramer</name>
</author>
</analytic>
</biblStruct>
</listBibl>
</div1>
</back>
</TEI>
<pmc article-type="research-article"><pmc-dir>properties open_access</pmc-dir>
<front><journal-meta><journal-id journal-id-type="nlm-ta">Front Neurorobot</journal-id>
<journal-id journal-id-type="iso-abbrev">Front Neurorobot</journal-id>
<journal-id journal-id-type="publisher-id">Front. Neurorobot.</journal-id>
<journal-title-group><journal-title>Frontiers in Neurorobotics</journal-title>
</journal-title-group>
<issn pub-type="epub">1662-5218</issn>
<publisher><publisher-name>Frontiers Media S.A.</publisher-name>
</publisher>
</journal-meta>
<article-meta><article-id pub-id-type="pmid">23097641</article-id>
<article-id pub-id-type="pmc">3477675</article-id>
<article-id pub-id-type="doi">10.3389/fnbot.2012.00009</article-id>
<article-categories><subj-group subj-group-type="heading"><subject>Neuroscience</subject>
<subj-group><subject>Original Research Article</subject>
</subj-group>
</subj-group>
</article-categories>
<title-group><article-title>Sensory prediction on a whiskered robot: a tactile analogy to “optical flow”</article-title>
</title-group>
<contrib-group><contrib contrib-type="author"><name><surname>Schroeder</surname>
<given-names>Christopher L.</given-names>
</name>
<xref ref-type="aff" rid="aff1"><sup>1</sup>
</xref>
</contrib>
<contrib contrib-type="author"><name><surname>Hartmann</surname>
<given-names>Mitra J. Z.</given-names>
</name>
<xref ref-type="aff" rid="aff1"><sup>1</sup>
</xref>
<xref ref-type="aff" rid="aff2"><sup>2</sup>
</xref>
<xref ref-type="author-notes" rid="fn001"><sup>*</sup>
</xref>
</contrib>
</contrib-group>
<aff id="aff1"><sup>1</sup>
<institution>Department of Biomedical Engineering, Northwestern University</institution>
<country>Evanston, IL, USA</country>
</aff>
<aff id="aff2"><sup>2</sup>
<institution>Department of Mechanical Engineering, Northwestern University</institution>
<country>Evanston, IL, USA</country>
</aff>
<author-notes><fn fn-type="edited-by"><p>Edited by: Robyn Grant, University of Sheffield, UK</p>
</fn>
<fn fn-type="edited-by"><p>Reviewed by: Quan Zou, University of Nevada, USA; Gerald Loeb, University of Southern California, USA</p>
</fn>
<corresp id="fn001">*Correspondence: Mitra J. Z. Hartmann, Mechanical Engineering Department, Biomedical Engineering Department, Northwestern University, 2145 Sheridan Road, Evanston, IL 60208, USA. e-mail: <email xlink:type="simple">m-hartmann@northwestern.edu</email>
</corresp>
</author-notes>
<pub-date pub-type="epreprint"><day>11</day>
<month>4</month>
<year>2012</year>
</pub-date>
<pub-date pub-type="epub"><day>22</day>
<month>10</month>
<year>2012</year>
</pub-date>
<pub-date pub-type="collection"><year>2012</year>
</pub-date>
<volume>6</volume>
<elocation-id>9</elocation-id>
<history><date date-type="received"><day>19</day>
<month>3</month>
<year>2012</year>
</date>
<date date-type="accepted"><day>20</day>
<month>7</month>
<year>2012</year>
</date>
</history>
<permissions><copyright-statement>Copyright © 2012 Schroeder and Hartmann.</copyright-statement>
<copyright-year>2012</copyright-year>
<license license-type="open-access" xlink:href="http://www.frontiersin.org/licenseagreement"><license-p>This is an open-access article distributed under the terms of the <uri xlink:type="simple" xlink:href="http://creativecommons.org/licenses/by/3.0/">Creative Commons Attribution License</uri>
, which permits use, distribution and reproduction in other forums, provided the original authors and source are credited and subject to any copyright notices concerning any third-party graphics etc.</license-p>
</license>
</permissions>
<abstract><p>When an animal moves an array of sensors (e.g., the hand, the eye) through the environment, spatial and temporal gradients of sensory data are related by the velocity of the moving sensory array. In vision, the relationship between spatial and temporal brightness gradients is quantified in the “optical flow” equation. In the present work, we suggest an analog to optical flow for the rodent vibrissal (whisker) array, in which the perceptual intensity that “flows” over the array is bending moment. Changes in bending moment are directly related to radial object distance, defined as the distance between the base of a whisker and the point of contact with the object. Using both simulations and a 1×5 array (row) of artificial whiskers, we demonstrate that local object curvature can be estimated based on differences in radial distance across the array. We then develop two algorithms, both based on tactile flow, to predict the future contact points that will be obtained as the whisker array translates along the object. The translation of the robotic whisker array represents the rat's head velocity. The first algorithm uses a calculation of the local object slope, while the second uses a calculation of the local object curvature. Both algorithms successfully predict future contact points for simple surfaces. The algorithm based on curvature was found to more accurately predict future contact points as surfaces became more irregular. We quantify the inter-related effects of whisker spacing and the object's spatial frequencies, and examine the issues that arise in the presence of real-world noise, friction, and slip.</p>
</abstract>
<kwd-group><kwd>rat</kwd>
<kwd>vibrissae</kwd>
<kwd>prediction</kwd>
<kwd>tactile flow</kwd>
</kwd-group>
<counts><fig-count count="12"></fig-count>
<table-count count="0"></table-count>
<equation-count count="27"></equation-count>
<ref-count count="19"></ref-count>
<page-count count="11"></page-count>
<word-count count="8196"></word-count>
</counts>
</article-meta>
</front>
<body><sec id="s1"><title>Introduction</title>
<p>As an animal moves through the environment, the spatial and temporal gradients of sensory data it acquires are related through the velocity of its moving sensory surfaces. This relationship is represented by the “complete derivative” (Munson et al., <xref ref-type="bibr" rid="B10">2009</xref>
), and represents a mathematically inviolate description of information flow over moving sensory surfaces.</p>
<p>In the field of visual neuroscience, the complete derivative has been termed the “optical flow” equation. The optical flow equation relates spatial and temporal intensity (brightness) gradients to the velocity of the animal (Barron et al., <xref ref-type="bibr" rid="B1">1994</xref>
; Beauchemin and Barron, <xref ref-type="bibr" rid="B2">1995</xref>
; Horn and Schunck, <xref ref-type="bibr" rid="B9">2003</xref>
). Recent papers have formalized the idea of “tactile flow” to describe the flow of strain energy density across the hand (Bicchi et al., <xref ref-type="bibr" rid="B4">2008</xref>
; Scilingo et al., <xref ref-type="bibr" rid="B12">2008</xref>
), and bending moment (torque) at the whisker base across the rodent vibrissal (whisker) array (Gopal and Hartmann, <xref ref-type="bibr" rid="B6">2007</xref>
; Hartmann, <xref ref-type="bibr" rid="B7">2009</xref>
).</p>
<p>Notably, the optic and tactile flow equations are typically used by assuming that the animal makes use of spatial and temporal gradients of brightness (vision) or strain energy (tactile) to compute the velocity of its sensor array.</p>
<p>We recently proposed a complementary scheme: namely, if the animal already knows its own velocity, then it can use the complete derivative to predict future sensory data (Gopal and Hartmann, <xref ref-type="bibr" rid="B6">2007</xref>
; Hartmann, <xref ref-type="bibr" rid="B7">2009</xref>
). Computing the complete derivative at multiple spatial scales would allow the animal to predict the stimulus that it will measure in the next sensory instant and provide a mechanism to distinguish between externally-generated and self-generated motion.</p>
<p>In the present work, we used the rat vibrissal system as a model to examine the plausibility of using the complete derivative to predict upcoming sensory data. Rats actively brush and tap their whiskers (vibrissae) against objects to tactually explore the environment. During detailed exploration of objects, rats move their vibrissae rhythmically, between 5 and 25 Hz (Welker, <xref ref-type="bibr" rid="B18">1964</xref>
; Berg and Kleinfeld, <xref ref-type="bibr" rid="B3">2003</xref>
). During navigation behaviors, however, rats often hold their whiskers out in a relatively static position as they follow along a wall or tunnel.</p>
<p>The present work was designed to investigate tactile flow across the vibrissal array in this type of translational navigation behavior. We used both simulations and a 1 by 5 array of artificial vibrissae (hardware) to investigate the plausibility of using the complete derivative to predict upcoming whisker-object contact points.</p>
</sec>
<sec sec-type="methods" id="s2"><title>Methods</title>
<p>Our initial investigations were performed in simulation, and we then investigated the real-world issues that arise with implementation on a 1 × 5 array of robotic whiskers.</p>
<sec><title>Algorithms for the determination of radial distance, slope, and curvature</title>
<sec><title>Radial distance determination using translations instead of rotations</title>
<p>Radial object distance is defined as the Euclidean distance between the base of a vibrissa and the point at which it makes contact with an object. Previous work has shown that an object's contour can be extracted by continuous rotation of a vibrissa against an object (Kaneko et al., <xref ref-type="bibr" rid="B9a">1998</xref>
; Solomon and Hartmann, <xref ref-type="bibr" rid="B14">2010</xref>
). As the vibrissa “sweeps” against the object through a rotation, measurement of the bending moment (torque) at the vibrissa base permits the radial object distance to be continuously computed, and the object contour thereby inferred. This technique was empirically validated with sweeps of a vibrissa past three differently shaped objects (Solomon and Hartmann, <xref ref-type="bibr" rid="B14">2010</xref>
). The rotational sweep models vibrissal motion during typical “whisking” behavior, in which the rat rotates its vibrissae at their base.</p>
<p>During wall-following behavior, however, rats do not always whisk, but sometimes keep their vibrissae protracted against the wall. This behavior is better modeled as a relative translation between vibrissa and object, rather than as a rotation. Although Solomon and Hartmann (<xref ref-type="bibr" rid="B14">2010</xref>
) developed equations to describe the translational sweep of a vibrissa past an object, the equations were not validated in hardware.</p>
<p>In the present study, we experimentally validate the translation equations developed in Solomon and Hartmann (<xref ref-type="bibr" rid="B14">2010</xref>
) and use them to extract object contours. Equations 1–3 below provide only a brief overview of the differences between radial distance extractions during rotation versus translation. A more complete description of radial distance extraction based on rotation is provided in Solomon and Hartmann (<xref ref-type="bibr" rid="B14">2010</xref>
).</p>
<p>As shown in previous work (Kaneko et al., <xref ref-type="bibr" rid="B9a">1998</xref>
; Solomon and Hartmann, <xref ref-type="bibr" rid="B13">2006</xref>
, <xref ref-type="bibr" rid="B13a">2008</xref>
, <xref ref-type="bibr" rid="B14">2010</xref>
, <xref ref-type="bibr" rid="B15">2011</xref>
; Birdwell et al., <xref ref-type="bibr" rid="B5">2007</xref>
) the radial distance <italic>r</italic>
<sub>0</sub>
to the initial contact point on an object can be calculated using
<disp-formula id="E1"><label>(1)</label>
<mml:math id="M1"><mml:mrow><mml:msub><mml:mi>r</mml:mi>
<mml:mn>0</mml:mn>
</mml:msub>
<mml:mo>=</mml:mo>
<mml:mi>k</mml:mi>
<mml:mfrac><mml:mrow><mml:msub><mml:mi>ϕ</mml:mi>
<mml:mn>0</mml:mn>
</mml:msub>
</mml:mrow>
<mml:mrow><mml:msub><mml:mi>M</mml:mi>
<mml:mn>0</mml:mn>
</mml:msub>
</mml:mrow>
</mml:mfrac>
</mml:mrow>
</mml:math>
</disp-formula>
where <italic>k</italic>
= 3<italic>EI</italic>
, <italic>E</italic>
is the elastic modulus of the vibrissa, <italic>I</italic>
is the area moment of inertia, ϕ<sub>0</sub>
is a small pushing angle beyond initial contact (typically about 3°), and <italic>M</italic>
<sub>0</sub>
is the bending moment at the vibrissa base.</p>
<p>Once the radial distance <italic>r</italic>
<sub>0</sub>
to the initial contact point is calculated, the whisker undergoes either a small rotation (<italic>d</italic>
ϕ) or translation (<italic>dL</italic>
). Radial distance at the current time step (<italic>r</italic>
<sub><italic>i</italic>
</sub>
) can then be calculated based on estimates of radial distance at previous time steps.</p>
<p>The procedures for calculating <italic>r</italic>
<sub><italic>i</italic>
</sub>
after a translation or rotation are quite similar, but they differ in the calculation of the magnitude of the vector <inline-formula><mml:math id="M20"><mml:mrow><mml:msub><mml:mover accent="true"><mml:mi>δ</mml:mi>
<mml:mo>¯</mml:mo>
</mml:mover>
<mml:mrow><mml:mi>i</mml:mi>
<mml:mo>−</mml:mo>
<mml:mn>1</mml:mn>
</mml:mrow>
</mml:msub>
</mml:mrow>
</mml:math>
</inline-formula>
, perpendicular to the longitudinal axis of the vibrissa at the contact point. With the x-axis defined to be parallel to the vibrissa at <italic>t</italic>
= <italic>t</italic>
<sub>0</sub>
, Solomon and Hartmann (<xref ref-type="bibr" rid="B14">2010</xref>
) define <inline-formula><mml:math id="M21"><mml:mrow><mml:msub><mml:mover accent="true"><mml:mi>δ</mml:mi>
<mml:mo>¯</mml:mo>
</mml:mover>
<mml:mrow><mml:mi>i</mml:mi>
<mml:mo>−</mml:mo>
<mml:mn>1</mml:mn>
</mml:mrow>
</mml:msub>
</mml:mrow>
</mml:math>
</inline-formula>
for rotation as:
<disp-formula id="E2"><label>(2)</label>
<mml:math id="M2"><mml:mrow><mml:msub><mml:mover accent="true"><mml:mi>δ</mml:mi>
<mml:mo>¯</mml:mo>
</mml:mover>
<mml:mrow><mml:mi>i</mml:mi>
<mml:mo>−</mml:mo>
<mml:mn>1</mml:mn>
</mml:mrow>
</mml:msub>
<mml:mo>=</mml:mo>
<mml:mo>−</mml:mo>
<mml:msub><mml:mi>r</mml:mi>
<mml:mrow><mml:mi>i</mml:mi>
<mml:mo>−</mml:mo>
<mml:mn>1</mml:mn>
</mml:mrow>
</mml:msub>
<mml:mo>·</mml:mo>
<mml:mi>d</mml:mi>
<mml:mi>ϕ</mml:mi>
<mml:mo>·</mml:mo>
<mml:mrow><mml:mo>[</mml:mo>
<mml:mrow><mml:mtable><mml:mtr><mml:mtd><mml:mrow><mml:mi>sin</mml:mi>
<mml:msub><mml:mi>ϕ</mml:mi>
<mml:mrow><mml:mi>i</mml:mi>
<mml:mo>−</mml:mo>
<mml:mn>1</mml:mn>
</mml:mrow>
</mml:msub>
</mml:mrow>
</mml:mtd>
</mml:mtr>
<mml:mtr><mml:mtd><mml:mrow><mml:mi>cos</mml:mi>
<mml:msub><mml:mi>ϕ</mml:mi>
<mml:mrow><mml:mi>i</mml:mi>
<mml:mo>−</mml:mo>
<mml:mn>1</mml:mn>
</mml:mrow>
</mml:msub>
</mml:mrow>
</mml:mtd>
</mml:mtr>
</mml:mtable>
</mml:mrow>
<mml:mo>]</mml:mo>
</mml:mrow>
<mml:mo>.</mml:mo>
</mml:mrow>
</mml:math>
</disp-formula>
where <italic>r</italic>
<sub><italic>i</italic>
−1</sub>
is the radial distance at the previous time step (before rotation), <italic>d</italic>
ϕ is the incremental rotation, and ϕ<sub><italic>i</italic>
−1</sub>
is the angle between the vibrissa base at time <italic>t</italic>
<sub>0</sub>
and the base at time <italic>t</italic>
<sub><italic>i</italic>
−1</sub>
(after rotation).</p>
<p>In contrast, <inline-formula><mml:math id="M22"><mml:mrow><mml:msub><mml:mover accent="true"><mml:mi>δ</mml:mi>
<mml:mo>¯</mml:mo>
</mml:mover>
<mml:mrow><mml:mi>i</mml:mi>
<mml:mo>−</mml:mo>
<mml:mn>1</mml:mn>
</mml:mrow>
</mml:msub>
</mml:mrow>
</mml:math>
</inline-formula>
for translation is defined by:
<disp-formula id="E3"><label>(3)</label>
<mml:math id="M3"><mml:mrow><mml:msub><mml:mover accent="true"><mml:mi>δ</mml:mi>
<mml:mo>¯</mml:mo>
</mml:mover>
<mml:mrow><mml:mi>i</mml:mi>
<mml:mo>−</mml:mo>
<mml:mn>1</mml:mn>
</mml:mrow>
</mml:msub>
<mml:mo>=</mml:mo>
<mml:mrow><mml:mo>[</mml:mo>
<mml:mrow><mml:mtable><mml:mtr><mml:mtd><mml:mn>0</mml:mn>
</mml:mtd>
</mml:mtr>
<mml:mtr><mml:mtd><mml:mrow><mml:mi>d</mml:mi>
<mml:mi>L</mml:mi>
</mml:mrow>
</mml:mtd>
</mml:mtr>
</mml:mtable>
</mml:mrow>
<mml:mo>]</mml:mo>
</mml:mrow>
<mml:mo>.</mml:mo>
</mml:mrow>
</mml:math>
</disp-formula>
where <italic>dL</italic>
is the incremental linear movement between time steps. It is important to note that the base of each vibrissa is fixed perpendicular to the direction of linear movement for this definition of <inline-formula><mml:math id="M23"><mml:mrow><mml:msub><mml:mover accent="true"><mml:mi>δ</mml:mi>
<mml:mo>¯</mml:mo>
</mml:mover>
<mml:mrow><mml:mi>i</mml:mi>
<mml:mo>−</mml:mo>
<mml:mn>1</mml:mn>
</mml:mrow>
</mml:msub>
</mml:mrow>
</mml:math>
</inline-formula>
.</p>
<p>The value of <inline-formula><mml:math id="M24"><mml:mrow><mml:msub><mml:mover accent="true"><mml:mi>δ</mml:mi>
<mml:mo>¯</mml:mo>
</mml:mover>
<mml:mrow><mml:mi>i</mml:mi>
<mml:mo>−</mml:mo>
<mml:mn>1</mml:mn>
</mml:mrow>
</mml:msub>
</mml:mrow>
</mml:math>
</inline-formula>
is then used to calculate the next radial distance <italic>r</italic>
<sub><italic>i</italic>
</sub>
, regardless of whether the whisker was translated or rotated. For a detailed explanation of this calculation, please refer to Figure <xref ref-type="fig" rid="F4">4</xref>
of Solomon and Hartmann (<xref ref-type="bibr" rid="B14">2010</xref>
) and Equations 6–11 also in Solomon and Hartmann (<xref ref-type="bibr" rid="B14">2010</xref>
).</p>
</sec>
<sec><title>Computing object slope and curvature from radial distances</title>
<p>The local slope (μ) and the local curvature (κ) of an object can be calculated based on radial distance measurements. To calculate either μ or κ, we first define our coordinate system as shown in Figure <xref ref-type="fig" rid="F1">1</xref>
. The distance <italic>ds</italic>
<sub><italic>i</italic>
</sub>
is the distance the base-point of the whisker has translated in timestep <italic>i</italic>
, and the direction of <italic>ds</italic>
is always coincident with the rat's velocity. Radial distance estimates at multiple time points, the angle <italic>d</italic>
θ, and the distance <italic>ds</italic>
can then be used to find the slope μ<sub><italic>i</italic>
</sub>
at each time step:
<disp-formula id="E4"><label>(4)</label>
<mml:math id="M4"><mml:mrow><mml:msub><mml:mi>μ</mml:mi>
<mml:mi>i</mml:mi>
</mml:msub>
<mml:mo>=</mml:mo>
<mml:mfrac><mml:mrow><mml:msub><mml:mi>R</mml:mi>
<mml:mi>i</mml:mi>
</mml:msub>
<mml:mo>−</mml:mo>
<mml:msub><mml:mi>R</mml:mi>
<mml:mrow><mml:mi>i</mml:mi>
<mml:mo>−</mml:mo>
<mml:mn>1</mml:mn>
</mml:mrow>
</mml:msub>
<mml:mo>+</mml:mo>
<mml:mi>d</mml:mi>
<mml:msub><mml:mi>s</mml:mi>
<mml:mi>i</mml:mi>
</mml:msub>
<mml:mo stretchy="false">(</mml:mo>
<mml:mi>d</mml:mi>
<mml:msub><mml:mi>θ</mml:mi>
<mml:mrow><mml:mi>i</mml:mi>
<mml:mo>−</mml:mo>
<mml:mn>1</mml:mn>
</mml:mrow>
</mml:msub>
<mml:mo>+</mml:mo>
<mml:mi>d</mml:mi>
<mml:msub><mml:mi>θ</mml:mi>
<mml:mi>i</mml:mi>
</mml:msub>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
<mml:mrow><mml:mi>d</mml:mi>
<mml:msub><mml:mi>s</mml:mi>
<mml:mi>i</mml:mi>
</mml:msub>
<mml:mo>−</mml:mo>
<mml:msub><mml:mi>R</mml:mi>
<mml:mi>i</mml:mi>
</mml:msub>
<mml:mo stretchy="false">(</mml:mo>
<mml:mi>d</mml:mi>
<mml:msub><mml:mi>θ</mml:mi>
<mml:mrow><mml:mi>i</mml:mi>
<mml:mo>−</mml:mo>
<mml:mn>1</mml:mn>
</mml:mrow>
</mml:msub>
<mml:mo>+</mml:mo>
<mml:mi>d</mml:mi>
<mml:msub><mml:mi>θ</mml:mi>
<mml:mi>i</mml:mi>
</mml:msub>
<mml:mo stretchy="false">)</mml:mo>
<mml:mo>+</mml:mo>
<mml:msub><mml:mi>R</mml:mi>
<mml:mrow><mml:mi>i</mml:mi>
<mml:mo>−</mml:mo>
<mml:mn>1</mml:mn>
</mml:mrow>
</mml:msub>
<mml:mi>d</mml:mi>
<mml:msub><mml:mi>θ</mml:mi>
<mml:mrow><mml:mi>i</mml:mi>
<mml:mo>−</mml:mo>
<mml:mn>1</mml:mn>
</mml:mrow>
</mml:msub>
</mml:mrow>
</mml:mfrac>
</mml:mrow>
</mml:math>
</disp-formula>
</p>
<fig id="F1" position="float"><label>Figure 1</label>
<caption><p><bold>Coordinate system for the determination of slope and curvature</bold>
. At each time step, radial distance is calculated relative to the object. The rat's velocity is indicated by <italic>V</italic>
<sub>rat</sub>
, and the arc <italic>s</italic>
is always parallel to <italic>V</italic>
<sub>rat</sub>
. The distance <italic>ds</italic>
<sub><italic>i</italic>
</sub>
is the distance in the direction of <italic>s</italic>
between discrete time measurements <italic>t</italic>
<sub><italic>i</italic>
</sub>
and <italic>t</italic>
<sub><italic>i</italic>
-1</sub>
. <italic>ds</italic>
<sub><italic>i</italic>
-1</sub>
is the distance in the direction of <italic>s</italic>
between discrete time measurements <italic>t</italic>
<sub><italic>i</italic>
-1</sub>
and <italic>t</italic>
<sub><italic>i</italic>
-2</sub>
. <italic>R</italic>
<sub><italic>i</italic>
</sub>
is the radial distance measure at the <italic>i</italic>
<sup>th</sup>
time step, <italic>d</italic>
θ<sub><italic>i</italic>
</sub>
is an angle measure of the change in direction of <italic>V</italic>
<sub>rat</sub>
, and μ<sub><italic>i</italic>
</sub>
represents the local slope of the object.</p>
</caption>
<graphic xlink:href="fnbot-06-00009-g0001"></graphic>
</fig>
<p>Slope μ<sub>i</sub>
is defined by the differences between radial distance measures (<italic>R</italic>
<sub><italic>i</italic>
</sub>
and <italic>R</italic>
<sub><italic>i</italic>
−1</sub>
) divided by the distance traveled (<italic>ds</italic>
<sub><italic>i</italic>
</sub>
). Each <italic>d</italic>
θ term accounts for changes in the rat velocity vector between radial distance measurements.</p>
<p>Calculation of curvature is similar, but requires us to first calculate the slope μ<sub><italic>i</italic>
−1</sub>
obtained in timestep <italic>i</italic>
−1:
<disp-formula id="E5"><label>(5)</label>
<mml:math id="M5"><mml:mrow><mml:msub><mml:mi>μ</mml:mi>
<mml:mrow><mml:mi>i</mml:mi>
<mml:mo>−</mml:mo>
<mml:mn>1</mml:mn>
</mml:mrow>
</mml:msub>
<mml:mo>=</mml:mo>
<mml:mfrac><mml:mrow><mml:msub><mml:mi>R</mml:mi>
<mml:mrow><mml:mi>i</mml:mi>
<mml:mo>−</mml:mo>
<mml:mn>1</mml:mn>
</mml:mrow>
</mml:msub>
<mml:mo>−</mml:mo>
<mml:msub><mml:mi>R</mml:mi>
<mml:mrow><mml:mi>i</mml:mi>
<mml:mo>−</mml:mo>
<mml:mn>2</mml:mn>
</mml:mrow>
</mml:msub>
<mml:mo>+</mml:mo>
<mml:mi>d</mml:mi>
<mml:msub><mml:mi>s</mml:mi>
<mml:mrow><mml:mi>i</mml:mi>
<mml:mo>−</mml:mo>
<mml:mn>1</mml:mn>
</mml:mrow>
</mml:msub>
<mml:mi>d</mml:mi>
<mml:msub><mml:mi>θ</mml:mi>
<mml:mrow><mml:mi>i</mml:mi>
<mml:mo>−</mml:mo>
<mml:mn>1</mml:mn>
</mml:mrow>
</mml:msub>
</mml:mrow>
<mml:mrow><mml:mi>d</mml:mi>
<mml:msub><mml:mi>s</mml:mi>
<mml:mrow><mml:mi>i</mml:mi>
<mml:mo>−</mml:mo>
<mml:mn>1</mml:mn>
</mml:mrow>
</mml:msub>
<mml:mo>−</mml:mo>
<mml:msub><mml:mi>R</mml:mi>
<mml:mrow><mml:mi>i</mml:mi>
<mml:mo>−</mml:mo>
<mml:mn>1</mml:mn>
</mml:mrow>
</mml:msub>
<mml:mi>d</mml:mi>
<mml:msub><mml:mi>θ</mml:mi>
<mml:mrow><mml:mi>i</mml:mi>
<mml:mo>−</mml:mo>
<mml:mn>1</mml:mn>
</mml:mrow>
</mml:msub>
</mml:mrow>
</mml:mfrac>
</mml:mrow>
</mml:math>
</disp-formula>
</p>
<p>Curvature is then defined using both μ<sub><italic>i</italic>
</sub>
and μ<sub><italic>i</italic>
−1</sub>
:
<disp-formula id="E6"><label>(6)</label>
<mml:math id="M6"><mml:mrow><mml:msub><mml:mi>κ</mml:mi>
<mml:mi>i</mml:mi>
</mml:msub>
<mml:mo>=</mml:mo>
<mml:mfrac><mml:mrow><mml:mrow><mml:mo>|</mml:mo>
<mml:mrow><mml:mfrac><mml:mrow><mml:msub><mml:mi>μ</mml:mi>
<mml:mi>i</mml:mi>
</mml:msub>
<mml:mo>−</mml:mo>
<mml:msub><mml:mi>μ</mml:mi>
<mml:mrow><mml:mi>i</mml:mi>
<mml:mo>−</mml:mo>
<mml:mn>1</mml:mn>
</mml:mrow>
</mml:msub>
</mml:mrow>
<mml:mrow><mml:mi>d</mml:mi>
<mml:msub><mml:mi>s</mml:mi>
<mml:mi>i</mml:mi>
</mml:msub>
</mml:mrow>
</mml:mfrac>
</mml:mrow>
<mml:mo>|</mml:mo>
</mml:mrow>
</mml:mrow>
<mml:mrow><mml:msup><mml:mrow><mml:mrow><mml:mo>[</mml:mo>
<mml:mrow><mml:mn>1</mml:mn>
<mml:mo>+</mml:mo>
<mml:msup><mml:mrow><mml:mrow><mml:mo>(</mml:mo>
<mml:mrow><mml:msub><mml:mi>μ</mml:mi>
<mml:mi>i</mml:mi>
</mml:msub>
</mml:mrow>
<mml:mo>)</mml:mo>
</mml:mrow>
</mml:mrow>
<mml:mn>2</mml:mn>
</mml:msup>
</mml:mrow>
<mml:mo>]</mml:mo>
</mml:mrow>
</mml:mrow>
<mml:mrow><mml:mfrac><mml:mn>3</mml:mn>
<mml:mn>2</mml:mn>
</mml:mfrac>
</mml:mrow>
</mml:msup>
</mml:mrow>
</mml:mfrac>
</mml:mrow>
</mml:math>
</disp-formula>
</p>
<p>This equation is simply the discretized version of the definition of curvature measured in 2D Cartesian coordinates. Notably, the commonly-used simplification of Equation 6 that assumes μ<sub>i</sub>
is small compared to unity (and therefore reduces the equation to just the numerator) was empirically found to be inaccurate. The small slope assumption does not always hold in our calculations.</p>
<p>When the rat's heading does not change significantly between timesteps, <italic>d</italic>
θ<sub><italic>i</italic>
</sub>
and <italic>d</italic>
θ<sub><italic>i</italic>
−1</sub>
are both zero and Equation 4 can be simplified to:
<disp-formula id="E7"><label>(7)</label>
<mml:math id="M7"><mml:mrow><mml:msub><mml:mi>μ</mml:mi>
<mml:mi>i</mml:mi>
</mml:msub>
<mml:mo>=</mml:mo>
<mml:mfrac><mml:mrow><mml:msub><mml:mi>R</mml:mi>
<mml:mi>i</mml:mi>
</mml:msub>
<mml:mo>−</mml:mo>
<mml:msub><mml:mi>R</mml:mi>
<mml:mrow><mml:mi>i</mml:mi>
<mml:mo>−</mml:mo>
<mml:mn>1</mml:mn>
</mml:mrow>
</mml:msub>
</mml:mrow>
<mml:mrow><mml:mi>d</mml:mi>
<mml:msub><mml:mi>s</mml:mi>
<mml:mi>i</mml:mi>
</mml:msub>
</mml:mrow>
</mml:mfrac>
</mml:mrow>
</mml:math>
</disp-formula>
where <italic>R</italic>
and <italic>s</italic>
still represent differences between radial distance measures (<italic>R</italic>
<sub><italic>i</italic>
</sub>
and <italic>R</italic>
<sub><italic>i</italic>
−1</sub>
) over the distance traveled (<italic>ds</italic>
<sub><italic>i</italic>
</sub>
). Equation 5 can be similarly simplified and Equation 6 remains the same.</p>
</sec>
<sec><title>Calculating slope and curvature based on radial distances measured with multiple whiskers</title>
<p>So far, we have described the sensory data obtained by a single whisker over time. Equations 4–7 apply equally well, however, to multiple whiskers making simultaneous contact with an object, at different locations on the object. In this case, the subscript <italic>i</italic>
in Equations 4–7 should be interpreted to mean the <italic>i</italic>
<sup>th</sup>
whisker, instead of the <italic>i</italic>
<sup>th</sup>
timestep. Figure <xref ref-type="fig" rid="F2">2</xref>
illustrates this idea. Figure <xref ref-type="fig" rid="F2">2A</xref>
illustrates that calculation of slope and curvature with a single vibrissa requires memory of the data acquired on the previous timestep. In contrast, Figure <xref ref-type="fig" rid="F2">2B</xref>
illustrates that calculation of slope and curvature with multiple vibrissa can be achieved within a single time step. This second method is equivalent to the rat integrating information across vibrissae within the array. In practice, calculation of slope and curvature can occur over both a single whisker (with memory) and multiple whiskers (at different spatial locations) simultaneously.</p>
<fig id="F2" position="float"><label>Figure 2</label>
<caption><p><bold>Computing slope and curvature over multiple vibrissae</bold>
. The inset in the middle of the figure emphasizes that radial distance <italic>R</italic>
is measured from the base of the whisker to the point at which the whisker contacts the object. <bold>(A)</bold>
In the single whisker method, we imagine that the rat compares sensory data acquired from a whisker with the data it remembers having acquired on the previous timesteps. The rat shaded gray indicates the location of the rat at time 1, and the rat in black outline indicates the location of the rat at time 2, having translated slightly forward. <bold>(B)</bold>
In the multiple whisker method, we imagine that the rat compares data across whiskers in the array at a single point in time. Both methods <bold>(A)</bold>
and <bold>(B)</bold>
can be used simultaneously to explore these different spatial scales in parallel.</p>
</caption>
<graphic xlink:href="fnbot-06-00009-g0002"></graphic>
</fig>
</sec>
</sec>
<sec><title>Prediction of future points of contact and future curvature over two different spatial scales</title>
<p>Equations 1–7 define the calculations used to find radial distance, local object slope, and local object curvature. Using these calculated values, we now show that it is possible to make predictions about the sensory data the animal will receive.</p>
<sec><title>“tactile flow” permits prediction of sensory data</title>
<p>Because animals control the movements of their limbs, they control the velocity with which sensory data flow over their sensory surfaces (Gopal and Hartmann, <xref ref-type="bibr" rid="B6">2007</xref>
; Bicchi et al., <xref ref-type="bibr" rid="B4">2008</xref>
; Nemenman et al., <xref ref-type="bibr" rid="B11">2008</xref>
; Scilingo et al., <xref ref-type="bibr" rid="B12">2008</xref>
; Hartmann, <xref ref-type="bibr" rid="B7">2009</xref>
). The time evolution of the flow field in space and time can be written via the complete derivative as shown in Equation 8.</p>
<disp-formula id="E8"><label>(8)</label>
<mml:math id="M8"><mml:mrow><mml:mfrac><mml:mrow><mml:mi>d</mml:mi>
<mml:msub><mml:mi>A</mml:mi>
<mml:mrow><mml:mi>s</mml:mi>
<mml:mi>e</mml:mi>
<mml:mi>n</mml:mi>
</mml:mrow>
</mml:msub>
</mml:mrow>
<mml:mrow><mml:mi>d</mml:mi>
<mml:mi>t</mml:mi>
</mml:mrow>
</mml:mfrac>
<mml:mo>=</mml:mo>
<mml:mfrac><mml:mrow><mml:mo>∂</mml:mo>
<mml:msub><mml:mi>A</mml:mi>
<mml:mrow><mml:mi>e</mml:mi>
<mml:mi>n</mml:mi>
<mml:mi>v</mml:mi>
</mml:mrow>
</mml:msub>
</mml:mrow>
<mml:mrow><mml:mo>∂</mml:mo>
<mml:mi>t</mml:mi>
</mml:mrow>
</mml:mfrac>
<mml:mo>+</mml:mo>
<mml:mi>V</mml:mi>
<mml:mo>•</mml:mo>
<mml:mo>∇</mml:mo>
<mml:msub><mml:mi>A</mml:mi>
<mml:mrow><mml:mi>s</mml:mi>
<mml:mi>e</mml:mi>
<mml:mi>n</mml:mi>
</mml:mrow>
</mml:msub>
</mml:mrow>
</mml:math>
</disp-formula>
<p>In this equation, <italic>A</italic>
is any quantity that is being measured (intensity, temperature, etc.), and the vector <italic>V</italic>
is the relative velocity between the sensory surface and the environment. The first term on the right represents intrinsic fluctuations in <italic>A</italic>
, that is, changes in the environment. If environmental fluctuations are slow on the time scale of the animal's movements, that term becomes zero and the progression of gradients is almost completely deterministic. New information flows over the edges of the sensory surface, but thereafter, values may be computed by calculating the spatial gradients of <italic>A</italic>
across the sensor. Equation 8 provides an inviolate mathematical description of information flow over moving sensory surfaces. The equation is not a model, it is necessarily true, in the same way that distance is equal to velocity integrated over time. Computing the terms of the complete derivative at multiple spatial and temporal scales would allow the animal to predict the stimulus that it will measure in the next sensory instant.</p>
</sec>
<sec><title>Interpreting “tactile flow” for an array of vibrissae</title>
<p>In this paper, we choose to represent “tactile flow” through radial distance of contact along the rat whisker because radial distance is directly related to changes in bending moment at the vibrissal base (Kaneko et al., <xref ref-type="bibr" rid="B9a">1998</xref>
; Solomon and Hartmann, <xref ref-type="bibr" rid="B13">2006</xref>
). Prediction of future radial distances is possible by choosing radial distance (<italic>R</italic>
) as the main parameter in the complete derivative shown in Equation 8. If the object being explored is static on the timescale of the animal's movements, then the first term on the right side of Equation 8 will be zero. In the context of the rat vibrissal system, we can therefore rewrite Equation 8 as follows:
<disp-formula id="E9"><label>(9)</label>
<mml:math id="M9"><mml:mrow><mml:mfrac><mml:mrow><mml:msub><mml:mi>R</mml:mi>
<mml:mrow><mml:mi>i</mml:mi>
<mml:mo>+</mml:mo>
<mml:mn>1</mml:mn>
</mml:mrow>
</mml:msub>
<mml:mo>−</mml:mo>
<mml:msub><mml:mi>R</mml:mi>
<mml:mi>i</mml:mi>
</mml:msub>
</mml:mrow>
<mml:mrow><mml:mo stretchy="false">(</mml:mo>
<mml:msub><mml:mi>t</mml:mi>
<mml:mrow><mml:mi>i</mml:mi>
<mml:mo>+</mml:mo>
<mml:mn>1</mml:mn>
</mml:mrow>
</mml:msub>
<mml:mo>−</mml:mo>
<mml:msub><mml:mi>t</mml:mi>
<mml:mi>i</mml:mi>
</mml:msub>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
</mml:mfrac>
<mml:mo>=</mml:mo>
<mml:mn>0</mml:mn>
<mml:mo>+</mml:mo>
<mml:mi>V</mml:mi>
<mml:mfrac><mml:mrow><mml:msub><mml:mi>R</mml:mi>
<mml:mi>i</mml:mi>
</mml:msub>
<mml:mo>−</mml:mo>
<mml:msub><mml:mi>R</mml:mi>
<mml:mrow><mml:mi>i</mml:mi>
<mml:mo>−</mml:mo>
<mml:mn>1</mml:mn>
</mml:mrow>
</mml:msub>
</mml:mrow>
<mml:mrow><mml:mi>d</mml:mi>
<mml:msub><mml:mi>s</mml:mi>
<mml:mi>i</mml:mi>
</mml:msub>
</mml:mrow>
</mml:mfrac>
<mml:mover><mml:mo>=</mml:mo>
<mml:mrow><mml:mtext>def</mml:mtext>
</mml:mrow>
</mml:mover>
<mml:mi>V</mml:mi>
<mml:msub><mml:mi>μ</mml:mi>
<mml:mi>i</mml:mi>
</mml:msub>
</mml:mrow>
</mml:math>
</disp-formula>
where <italic>R</italic>
<sub>i+1</sub>
is the radial distance of the future point of contact, <italic>R</italic>
<sub><italic>i</italic>
</sub>
is the current radial distance, <italic>t</italic>
<sub>i+1</sub>
and <italic>t</italic>
<sub><italic>i</italic>
</sub>
are the times at which the radial distances are measured, <italic>V</italic>
is the translational velocity of the rat, <italic>ds</italic>
<sub><italic>i</italic>
</sub>
is the distance traveled in the last time step, and μ<sub><italic>i</italic>
</sub>
is the current slope. Rearranging the equation and substituting μ<sub><italic>i</italic>
</sub>
as in the last term above yields:
<disp-formula id="E10"><label>(10)</label>
<mml:math id="M10"><mml:mrow><mml:msub><mml:mi>R</mml:mi>
<mml:mrow><mml:mi>i</mml:mi>
<mml:mo>+</mml:mo>
<mml:mn>1</mml:mn>
</mml:mrow>
</mml:msub>
<mml:mo>=</mml:mo>
<mml:msub><mml:mi>R</mml:mi>
<mml:mi>i</mml:mi>
</mml:msub>
<mml:mo>+</mml:mo>
<mml:mi>V</mml:mi>
<mml:msub><mml:mi>μ</mml:mi>
<mml:mi>i</mml:mi>
</mml:msub>
<mml:mo stretchy="false">(</mml:mo>
<mml:msub><mml:mi>t</mml:mi>
<mml:mrow><mml:mi>i</mml:mi>
<mml:mo>+</mml:mo>
<mml:mn>1</mml:mn>
</mml:mrow>
</mml:msub>
<mml:mo>−</mml:mo>
<mml:msub><mml:mi>t</mml:mi>
<mml:mi>i</mml:mi>
</mml:msub>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
</mml:math>
</disp-formula>
</p>
<p>Thus it is clear that future radial distance can be estimated from the current slope.</p>
<p>If the slope of the object is changing, we expect the current curvature of the object to be able to give a better estimate of future radial distance. To use curvature, we first predict the future slope of the object, and then use that predicted slope to predict future radial distance. The future slope μ<sub><italic>i</italic>
+1</sub>
is found by choosing μ as the parameter in Equation 8, as shown in Equation 11:
<disp-formula id="E11"><label>(11)</label>
<mml:math id="M11"><mml:mrow><mml:mfrac><mml:mrow><mml:msub><mml:mi>μ</mml:mi>
<mml:mrow><mml:mi>i</mml:mi>
<mml:mo>+</mml:mo>
<mml:mn>1</mml:mn>
</mml:mrow>
</mml:msub>
<mml:mo>−</mml:mo>
<mml:msub><mml:mi>μ</mml:mi>
<mml:mi>i</mml:mi>
</mml:msub>
</mml:mrow>
<mml:mrow><mml:mo stretchy="false">(</mml:mo>
<mml:msub><mml:mi>t</mml:mi>
<mml:mrow><mml:mi>i</mml:mi>
<mml:mo>+</mml:mo>
<mml:mn>1</mml:mn>
</mml:mrow>
</mml:msub>
<mml:mo>−</mml:mo>
<mml:msub><mml:mi>t</mml:mi>
<mml:mi>i</mml:mi>
</mml:msub>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
</mml:mfrac>
<mml:mo>=</mml:mo>
<mml:mn>0</mml:mn>
<mml:mo>+</mml:mo>
<mml:mi>V</mml:mi>
<mml:mfrac><mml:mrow><mml:msub><mml:mi>μ</mml:mi>
<mml:mi>i</mml:mi>
</mml:msub>
<mml:mo>−</mml:mo>
<mml:msub><mml:mi>μ</mml:mi>
<mml:mrow><mml:mi>i</mml:mi>
<mml:mo>−</mml:mo>
<mml:mn>1</mml:mn>
</mml:mrow>
</mml:msub>
</mml:mrow>
<mml:mrow><mml:mi>d</mml:mi>
<mml:msub><mml:mi>s</mml:mi>
<mml:mi>i</mml:mi>
</mml:msub>
</mml:mrow>
</mml:mfrac>
</mml:mrow>
</mml:math>
</disp-formula>
</p>
<p>The simplification that <inline-formula><mml:math id="M25"><mml:mrow><mml:msub><mml:mi>κ</mml:mi>
<mml:mi>i</mml:mi>
</mml:msub>
<mml:mo>=</mml:mo>
<mml:mfrac><mml:mrow><mml:msub><mml:mi>μ</mml:mi>
<mml:mi>i</mml:mi>
</mml:msub>
<mml:mo>−</mml:mo>
<mml:msub><mml:mi>μ</mml:mi>
<mml:mrow><mml:mi>i</mml:mi>
<mml:mo>−</mml:mo>
<mml:mn>1</mml:mn>
</mml:mrow>
</mml:msub>
</mml:mrow>
<mml:mrow><mml:mi>d</mml:mi>
<mml:msub><mml:mi>s</mml:mi>
<mml:mi>i</mml:mi>
</mml:msub>
</mml:mrow>
</mml:mfrac>
</mml:mrow>
</mml:math>
</inline-formula>
was empirically found to generate significant error in our results. Therefore, in Equation 11 we replace <inline-formula><mml:math id="M26"><mml:mrow><mml:mfrac><mml:mrow><mml:msub><mml:mi>μ</mml:mi>
<mml:mi>i</mml:mi>
</mml:msub>
<mml:mo>−</mml:mo>
<mml:msub><mml:mi>μ</mml:mi>
<mml:mrow><mml:mi>i</mml:mi>
<mml:mo>−</mml:mo>
<mml:mn>1</mml:mn>
</mml:mrow>
</mml:msub>
</mml:mrow>
<mml:mrow><mml:mi>d</mml:mi>
<mml:msub><mml:mi>s</mml:mi>
<mml:mi>i</mml:mi>
</mml:msub>
</mml:mrow>
</mml:mfrac>
</mml:mrow>
</mml:math>
</inline-formula>
with the full equation for κ<sub><italic>i</italic>
</sub>
as shown in Equation 6, yielding:
<disp-formula id="E12"><label>(12)</label>
<mml:math id="M12"><mml:mrow><mml:msub><mml:mi>μ</mml:mi>
<mml:mrow><mml:mi>i</mml:mi>
<mml:mo>+</mml:mo>
<mml:mn>1</mml:mn>
</mml:mrow>
</mml:msub>
<mml:mo>=</mml:mo>
<mml:msub><mml:mi>μ</mml:mi>
<mml:mi>i</mml:mi>
</mml:msub>
<mml:mo>+</mml:mo>
<mml:mi>V</mml:mi>
<mml:msub><mml:mi>κ</mml:mi>
<mml:mi>i</mml:mi>
</mml:msub>
<mml:mrow><mml:mo>(</mml:mo>
<mml:mrow><mml:msub><mml:mi>t</mml:mi>
<mml:mrow><mml:mi>i</mml:mi>
<mml:mo>+</mml:mo>
<mml:mn>1</mml:mn>
</mml:mrow>
</mml:msub>
<mml:mo>−</mml:mo>
<mml:msub><mml:mi>t</mml:mi>
<mml:mi>i</mml:mi>
</mml:msub>
</mml:mrow>
<mml:mo>)</mml:mo>
</mml:mrow>
<mml:mo>=</mml:mo>
<mml:msub><mml:mi>μ</mml:mi>
<mml:mi>i</mml:mi>
</mml:msub>
<mml:mo>+</mml:mo>
<mml:mi>V</mml:mi>
<mml:mfrac><mml:mrow><mml:mrow><mml:mo>|</mml:mo>
<mml:mrow><mml:mfrac><mml:mrow><mml:msub><mml:mi>μ</mml:mi>
<mml:mi>i</mml:mi>
</mml:msub>
<mml:mo>−</mml:mo>
<mml:msub><mml:mi>μ</mml:mi>
<mml:mrow><mml:mi>i</mml:mi>
<mml:mo>−</mml:mo>
<mml:mn>1</mml:mn>
</mml:mrow>
</mml:msub>
</mml:mrow>
<mml:mrow><mml:mi>d</mml:mi>
<mml:msub><mml:mi>s</mml:mi>
<mml:mi>i</mml:mi>
</mml:msub>
</mml:mrow>
</mml:mfrac>
</mml:mrow>
<mml:mo>|</mml:mo>
</mml:mrow>
</mml:mrow>
<mml:mrow><mml:msup><mml:mrow><mml:mrow><mml:mo>[</mml:mo>
<mml:mrow><mml:mn>1</mml:mn>
<mml:mo>+</mml:mo>
<mml:msup><mml:mrow><mml:mrow><mml:mo>(</mml:mo>
<mml:mrow><mml:msub><mml:mi>μ</mml:mi>
<mml:mi>i</mml:mi>
</mml:msub>
</mml:mrow>
<mml:mo>)</mml:mo>
</mml:mrow>
</mml:mrow>
<mml:mn>2</mml:mn>
</mml:msup>
</mml:mrow>
<mml:mo>]</mml:mo>
</mml:mrow>
</mml:mrow>
<mml:mrow><mml:mfrac><mml:mn>3</mml:mn>
<mml:mn>2</mml:mn>
</mml:mfrac>
</mml:mrow>
</mml:msup>
</mml:mrow>
</mml:mfrac>
<mml:mrow><mml:mo>(</mml:mo>
<mml:mrow><mml:msub><mml:mi>t</mml:mi>
<mml:mrow><mml:mi>i</mml:mi>
<mml:mo>+</mml:mo>
<mml:mn>1</mml:mn>
</mml:mrow>
</mml:msub>
<mml:mo>−</mml:mo>
<mml:msub><mml:mi>t</mml:mi>
<mml:mi>i</mml:mi>
</mml:msub>
</mml:mrow>
<mml:mo>)</mml:mo>
</mml:mrow>
</mml:mrow>
</mml:math>
</disp-formula>
where μ<sub><italic>i</italic>
+1</sub>
is the local object slope at the future point of contact, μ<sub><italic>i</italic>
</sub>
is the current local object slope, <italic>V</italic>
is the translational velocity of the rat, κ<sub><italic>i</italic>
</sub>
is the current local object curvature, and <italic>t</italic>
<sub><italic>i</italic>
+1</sub>
and <italic>t</italic>
<sub><italic>i</italic>
</sub>
are the times at which the radial distances used to calculate slope and curvature are measured. When Equation 12 is substituted into Equation 10 (with μ<sub>i +1</sub>
replacing μ<sub><italic>i</italic>
</sub>
), we obtain an equation that estimates future radial distance based on both current slope and current curvature:
<disp-formula id="E13"><label>(13)</label>
<mml:math id="M13"><mml:mrow><mml:msub><mml:mi>R</mml:mi>
<mml:mrow><mml:mi>i</mml:mi>
<mml:mo>+</mml:mo>
<mml:mn>1</mml:mn>
</mml:mrow>
</mml:msub>
<mml:mo>=</mml:mo>
<mml:msub><mml:mi>R</mml:mi>
<mml:mi>i</mml:mi>
</mml:msub>
<mml:mo>+</mml:mo>
<mml:mi>V</mml:mi>
<mml:mo stretchy="false">(</mml:mo>
<mml:msub><mml:mi>μ</mml:mi>
<mml:mi>i</mml:mi>
</mml:msub>
<mml:mo>+</mml:mo>
<mml:mi>V</mml:mi>
<mml:msub><mml:mi>κ</mml:mi>
<mml:mi>i</mml:mi>
</mml:msub>
<mml:mo stretchy="false">(</mml:mo>
<mml:msub><mml:mi>t</mml:mi>
<mml:mrow><mml:mi>i</mml:mi>
<mml:mo>+</mml:mo>
<mml:mn>1</mml:mn>
</mml:mrow>
</mml:msub>
<mml:mo>−</mml:mo>
<mml:msub><mml:mi>t</mml:mi>
<mml:mi>i</mml:mi>
</mml:msub>
<mml:mo stretchy="false">)</mml:mo>
<mml:mo stretchy="false">)</mml:mo>
<mml:mo stretchy="false">(</mml:mo>
<mml:msub><mml:mi>t</mml:mi>
<mml:mrow><mml:mi>i</mml:mi>
<mml:mo>+</mml:mo>
<mml:mn>1</mml:mn>
</mml:mrow>
</mml:msub>
<mml:mo>−</mml:mo>
<mml:msub><mml:mi>t</mml:mi>
<mml:mi>i</mml:mi>
</mml:msub>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
</mml:math>
</disp-formula>
</p>
<p>Finally, in the type of wall following behavior and environmental exploration in which prediction would be most useful to a rat, it is more likely that significant changes in calculated local object slope and local object curvature are due to measurement error than due to abrupt changes in the object. To decrease the sensitivity of predicted radial distance to measurement error, we average the local slope and curvature as follows:
<disp-formula id="E14"><label>(14)</label>
<mml:math id="M14"><mml:mrow><mml:msub><mml:mi>μ</mml:mi>
<mml:mrow><mml:mtext>avg</mml:mtext>
</mml:mrow>
</mml:msub>
<mml:mo>=</mml:mo>
<mml:mfrac><mml:mn>1</mml:mn>
<mml:mrow><mml:mo stretchy="false">(</mml:mo>
<mml:mi>N</mml:mi>
<mml:mo>−</mml:mo>
<mml:mn>1</mml:mn>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
</mml:mfrac>
<mml:mstyle displaystyle="true"><mml:munderover><mml:mo>∑</mml:mo>
<mml:mi>i</mml:mi>
<mml:mrow><mml:mi>N</mml:mi>
<mml:mo>−</mml:mo>
<mml:mn>1</mml:mn>
</mml:mrow>
</mml:munderover>
<mml:mrow><mml:msub><mml:mi>μ</mml:mi>
<mml:mi>i</mml:mi>
</mml:msub>
</mml:mrow>
</mml:mstyle>
</mml:mrow>
</mml:math>
</disp-formula>
<disp-formula id="E15"><label>(15)</label>
<mml:math id="M15"><mml:mrow><mml:msub><mml:mi>κ</mml:mi>
<mml:mrow><mml:mtext>avg</mml:mtext>
</mml:mrow>
</mml:msub>
<mml:mo>=</mml:mo>
<mml:mfrac><mml:mtext>1</mml:mtext>
<mml:mrow><mml:mo stretchy="false">(</mml:mo>
<mml:mi>N</mml:mi>
<mml:mo>−</mml:mo>
<mml:mn>2</mml:mn>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
</mml:mfrac>
<mml:mstyle displaystyle="true"><mml:munderover><mml:mo>∑</mml:mo>
<mml:mi>i</mml:mi>
<mml:mrow><mml:mi>N</mml:mi>
<mml:mo>−</mml:mo>
<mml:mn>2</mml:mn>
</mml:mrow>
</mml:munderover>
<mml:mrow><mml:msub><mml:mi>κ</mml:mi>
<mml:mi>i</mml:mi>
</mml:msub>
</mml:mrow>
</mml:mstyle>
</mml:mrow>
</mml:math>
</disp-formula>
where μ<sub>avg</sub>
is the average slope, κ<sub>avg</sub>
is the average curvature, <italic>N</italic>
is either the number of past time steps (c.f., Figure <xref ref-type="fig" rid="F2">2A</xref>
) or the number of vibrissae being used (Figure <xref ref-type="fig" rid="F2">2B</xref>
), μ<sub><italic>i</italic>
</sub>
is the local object slope between each radial distance measurement, and κ<sub><italic>i</italic>
</sub>
is the local object curvature between each calculated slope value. Substituting Equations 14 and 15 into Equations 10 and 13 yields:
<disp-formula id="E16"><label>(16)</label>
<mml:math id="M16"><mml:mrow><mml:msub><mml:mi>R</mml:mi>
<mml:mrow><mml:mi>i</mml:mi>
<mml:mo>+</mml:mo>
<mml:mn>1</mml:mn>
</mml:mrow>
</mml:msub>
<mml:mo>=</mml:mo>
<mml:msub><mml:mi>R</mml:mi>
<mml:mi>i</mml:mi>
</mml:msub>
<mml:mo>+</mml:mo>
<mml:mi>V</mml:mi>
<mml:msub><mml:mi>μ</mml:mi>
<mml:mrow><mml:mtext>avg</mml:mtext>
</mml:mrow>
</mml:msub>
<mml:mo stretchy="false">(</mml:mo>
<mml:msub><mml:mi>t</mml:mi>
<mml:mrow><mml:mi>i</mml:mi>
<mml:mo>+</mml:mo>
<mml:mn>1</mml:mn>
</mml:mrow>
</mml:msub>
<mml:mo>−</mml:mo>
<mml:msub><mml:mi>t</mml:mi>
<mml:mi>i</mml:mi>
</mml:msub>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
</mml:math>
</disp-formula>
and
<disp-formula id="E17"><label>(17)</label>
<mml:math id="M17"><mml:mrow><mml:msub><mml:mi>R</mml:mi>
<mml:mrow><mml:mi>i</mml:mi>
<mml:mo>+</mml:mo>
<mml:mn>1</mml:mn>
</mml:mrow>
</mml:msub>
<mml:mo>=</mml:mo>
<mml:msub><mml:mi>R</mml:mi>
<mml:mi>i</mml:mi>
</mml:msub>
<mml:mo>+</mml:mo>
<mml:mi>V</mml:mi>
<mml:mo stretchy="false">(</mml:mo>
<mml:msub><mml:mi>μ</mml:mi>
<mml:mi>i</mml:mi>
</mml:msub>
<mml:mo>+</mml:mo>
<mml:mi>V</mml:mi>
<mml:msub><mml:mi>κ</mml:mi>
<mml:mrow><mml:mtext>avg</mml:mtext>
</mml:mrow>
</mml:msub>
<mml:mo stretchy="false">(</mml:mo>
<mml:msub><mml:mi>t</mml:mi>
<mml:mrow><mml:mi>i</mml:mi>
<mml:mo>+</mml:mo>
<mml:mn>1</mml:mn>
</mml:mrow>
</mml:msub>
<mml:mo>−</mml:mo>
<mml:msub><mml:mi>t</mml:mi>
<mml:mi>i</mml:mi>
</mml:msub>
<mml:mo stretchy="false">)</mml:mo>
<mml:mo stretchy="false">)</mml:mo>
<mml:mo stretchy="false">(</mml:mo>
<mml:msub><mml:mi>t</mml:mi>
<mml:mrow><mml:mi>i</mml:mi>
<mml:mo>+</mml:mo>
<mml:mn>1</mml:mn>
</mml:mrow>
</mml:msub>
<mml:mo>−</mml:mo>
<mml:msub><mml:mi>t</mml:mi>
<mml:mi>i</mml:mi>
</mml:msub>
<mml:mo stretchy="false">)</mml:mo>
</mml:mrow>
</mml:math>
</disp-formula>
</p>
</sec>
<sec><title>Simultaneous prediction with single and multiple vibrissae</title>
<p>As illustrated in Figure <xref ref-type="fig" rid="F2">2</xref>
, local object slopes and curvatures can be computed either using a single whisker (with memory) or using multiple whiskers (distributed in space). For each of these two spatial scales, we can use either Equation 16 or Equation 17 to predict future contact points. We note that the use of multiple vibrissa permits the calculation of slope and curvature within a single timestep. In contrast, two or three timesteps are required to calculate slope and curvature using a single vibrissa. In addition, multiple vibrissae can be used to rapidly compute surface gradients on a larger spatial scale than would be possible with a single whisker. Using a single whisker would require memory of a duration equal to the inter-whisker-spacing divided by the velocity of the array, in order to obtain slope and curvature estimates at a spatial scale comparable to those obtained by multiple whiskers. Thus, there is a tradeoff between spatial scale and memory. Of course, computations can be done at both spatial scales (single and multiple whiskers) simultaneously.</p>
</sec>
</sec>
<sec><title>Hardware methods</title>
<p>Radial object distance is defined as the Euclidean distance between the base of a vibrissa and the point of object contact (Szwed et al., <xref ref-type="bibr" rid="B16">2003</xref>
; Birdwell et al., <xref ref-type="bibr" rid="B5">2007</xref>
). Previous work has shown that an object's contour can be extracted by continuous rotation of a vibrissa against an object (Solomon and Hartmann, <xref ref-type="bibr" rid="B14">2010</xref>
). As the vibrissa “sweeps” against the object through a rotation, measurement of the bending moment at the vibrissa base permits the radial object distance to be continuously computed, and the object contour thereby inferred. This technique was empirically validated with sweeps of a vibrissa past three differently shaped objects (Solomon and Hartmann, <xref ref-type="bibr" rid="B14">2010</xref>
). This same study demonstrated that a similar algorithm would work for translation of the vibrissa instead of rotation, but the translation technique was not empirically validated.</p>
<sec><title>Vibrissa and vibrissa array design</title>
<p>The present work used a single horizontal row of a five by five array of vibrissae (Figure <xref ref-type="fig" rid="F3">3A</xref>
). Vibrissae were constructed from Nitinol wire 4 cm in length and 500 μm in diameter. Nitinol wire was chosen because it is highly elastic and tends not to kink. Each wire was mounted in a 4 mm x 4 mm rectangular aluminum block with a strain gauge (Omega Engineering) attached to each block face (Figure <xref ref-type="fig" rid="F3">3B</xref>
). This vibrissa design allows for a 2-D measure of strain, but in the present study the measured strain in the vertical plane was negligible compared to the strain in the plane of object translation (the horizontal plane).</p>
<fig id="F3" position="float"><label>Figure 3</label>
<caption><p><bold>(A)</bold>
5 × 5 whisker array on individual rotating platforms and <bold>(B)</bold>
individual whisker composed of 4 350 ohm strain gauges measuring the bending moment of a 0.020 diameter superelastic Nitinol wire.</p>
</caption>
<graphic xlink:href="fnbot-06-00009-g0003"></graphic>
</fig>
</sec>
<sec><title>Linear actuation</title>
<p>A linear actuation system was built to model the forward (translational) movement of a rat as it explores its environment. Because the vibrissa array was tethered with power and signal cables, it was easier to translate an object past the stationary vibrissa array than it was to translate the array past the object. In the present work, these two paradigms are equivalent because we are concerned only with relative velocity between the array and object. This study did not explore methods to distinguish between self-generated versus external movements.</p>
<p>As shown in Figure <xref ref-type="fig" rid="F4">4</xref>
, a wheeled cart carried a test object along a track a fixed distance from the vibrissa array. The motion of the cart was controlled by an Animatics SmartMotor. The programmable motor controller and associated 4000 count/rev encoder allowed accurate position measurements within 10 μm. In practice, however, we only found it necessary to calculate position to within 0.1 mm. Similarly, velocity was calculated to within 0.1 mm/sec. These levels of accuracy were chosen because noise dominated the measurement error below these thresholds, causing there to be no appreciable difference in position measurement with increasing accuracy.</p>
<fig id="F4" position="float"><label>Figure 4</label>
<caption><p><bold>Linear actuation system with test objects and artificial whiskers</bold>
.</p>
</caption>
<graphic xlink:href="fnbot-06-00009-g0004"></graphic>
</fig>
</sec>
<sec><title>Device calibration</title>
<p>The two strain gauges for each sensing dimension on each vibrissa were arranged in a half Wheatstone bridge so the bending of the vibrissa created a change in voltage at the output of the circuit. The resting output was zeroed with a potentiometer. The actual value of the voltage output depended on circuit parameters such as gain, so it was necessary to calibrate the voltage output to the curvature at the base of the vibrissa. To calibrate the voltage to the curvature, the vibrissa was rotated against a peg placed at a known distance from the vibrissa base. For cylindrical homogenous vibrissae, curvature and moment differ only by a scaling factor. Given the known angular deflection of the cylindrical vibrissa and the distance between the base and peg, Solomon and Hartmann have shown that the moment can be calculated based on Euler-Bernoulli beam theory (Solomon and Hartmann, <xref ref-type="bibr" rid="B14">2010</xref>
).</p>
<p>Once a vibrissa has been calibrated, the voltage recorded from that vibrissa is converted to moment at the base of the vibrissa. The radial distance <italic>r</italic>
<sub>0</sub>
to the initial contact point is calculated using Equation 1.</p>
</sec>
<sec><title>Error calculations in simulation and hardware</title>
<p>To quantify the accuracy of radial distance prediction using each method, prediction error was defined as:
<disp-formula id="E18"><label>(18)</label>
<mml:math id="M18"><mml:mrow><mml:msub><mml:mi>E</mml:mi>
<mml:mrow><mml:mi>p</mml:mi>
<mml:mi>r</mml:mi>
<mml:mi>e</mml:mi>
<mml:mi>d</mml:mi>
</mml:mrow>
</mml:msub>
<mml:mo>=</mml:mo>
<mml:mfrac><mml:mn>1</mml:mn>
<mml:mi>N</mml:mi>
</mml:mfrac>
<mml:mstyle displaystyle="true"><mml:munderover><mml:mo>∑</mml:mo>
<mml:mrow><mml:mi>i</mml:mi>
<mml:mo>=</mml:mo>
<mml:mn>1</mml:mn>
</mml:mrow>
<mml:mi>N</mml:mi>
</mml:munderover>
<mml:mrow><mml:mrow><mml:mo>|</mml:mo>
<mml:mrow><mml:mfrac><mml:mrow><mml:mi>P</mml:mi>
<mml:mi>R</mml:mi>
<mml:msub><mml:mi>D</mml:mi>
<mml:mi>i</mml:mi>
</mml:msub>
<mml:mo>−</mml:mo>
<mml:mi>M</mml:mi>
<mml:mi>R</mml:mi>
<mml:msub><mml:mi>D</mml:mi>
<mml:mi>i</mml:mi>
</mml:msub>
</mml:mrow>
<mml:mrow><mml:mi>M</mml:mi>
<mml:mi>R</mml:mi>
<mml:msub><mml:mi>D</mml:mi>
<mml:mi>i</mml:mi>
</mml:msub>
</mml:mrow>
</mml:mfrac>
</mml:mrow>
<mml:mo>|</mml:mo>
</mml:mrow>
</mml:mrow>
</mml:mstyle>
</mml:mrow>
</mml:math>
</disp-formula>
where <italic>E</italic>
<sub><italic>pred</italic>
</sub>
is the prediction error, <italic>N</italic>
is the number of samples in a trial, <italic>PRD</italic>
<sub><italic>i</italic>
</sub>
is the predicted radial distance for each sample, and <italic>MRD</italic>
<sub><italic>i</italic>
</sub>
is the measured radial distance for each sample. <italic>E</italic>
<sub><italic>pred</italic>
</sub>
, which we define as prediction error, is the mean absolute error of the prediction. It is mean absolute percent error (MAPE) when multiplied by 100. For simulated results, <italic>MRD</italic>
<sub><italic>i</italic>
</sub>
is chosen to be accurate to machine precision. This choice results in a prediction error that solely measures the accuracy of the prediction algorithm for a given set of parameters. In hardware, <italic>MRD</italic>
<sub><italic>i</italic>
</sub>
is calculated using the measured bending moment <italic>M</italic>
as shown in Equation 1. In this case, prediction error <italic>E</italic>
<sub><italic>pred</italic>
</sub>
is affected both by measurement error as well as the accuracy of the prediction algorithm. In practice, however, errors in radial distance extraction (measurement errors) were small compared to errors in prediction.</p>
</sec>
</sec>
</sec>
<sec sec-type="results" id="s3"><title>Results</title>
<p>As described in <italic>Methods</italic>
, we use both Equation 16 (prediction using slope) and Equation 17 (prediction using curvature) to predict upcoming radial distance, and we use the two equations at different spatial scales.</p>
<sec><title>Prediction: simulation results</title>
<p>In all simulations in this section, we assume “perfect” radial distance extraction at time 1, and then calculate slope and curvature to predict radial distance at time 2. In other words, we do not simulate whisker deflection. The goal of this section is to verify that the use of either slope or curvature is sufficient for the prediction of future radial distance. Simulation will also show whether the increased mathematical complexity required by the use of local curvature leads to significantly increased predictive accuracy over the simpler equation for local slope.</p>
<p>In these simulations, the data collection method (i.e., single vibrissa or multiple vibrissa) is irrelevant, as the main difference between the two methods is spatiotemporal scale—the simulated objects can be made to arbitrary size and the sampling rate can be increased or decreased arbitrarily.</p>
<p>To quantify prediction error from the use of Equations 16 and 17, we simulated translation of the whiskers past several differently sized cylinders. We then quantified how well the predicted values matched actual values. The results of this simulation are shown in Figure <xref ref-type="fig" rid="F5">5</xref>
. As expected, both local object curvature and local object slope were good predictors of future radial distance, with error less than 0.1 ± 0.07% for each method. In these simulations, the error results only from discretization of slope and curvature.</p>
<fig id="F5" position="float"><label>Figure 5</label>
<caption><p><bold>(A)</bold>
Relationship between predicted and actual radial distance for prediction using local object slope <bold>(B)</bold>
Relationship between predicted and actual radial distance for prediction using local object curvature.</p>
</caption>
<graphic xlink:href="fnbot-06-00009-g0005"></graphic>
</fig>
<p>Figure <xref ref-type="fig" rid="F6">6</xref>
shows the results of simulating vibrissa contact with two different objects. Predictions about the future shape of the object were made using both Equations 16 and 17. The accuracy of these predictions for these simulated objects gives insight into the accuracy of each prediction method and shows the advantages and disadvantages of prediction using these two different equations.</p>
<fig id="F6" position="float"><label>Figure 6</label>
<caption><p><bold>(A) Radial distance predictions using both local object slope (red dots) and curvature (blue dots) for a shape with gradually changing curvature</bold>
. Prediction error is 6.37 ± 6.81% for local slope prediction and 3.02 ± 1.52% for local curvature prediction. It can be seen that local slope prediction leads to a slight overshoot when object curvature increases. <bold>(B)</bold>
Equation 16 (prediction using slope) is used to predict radial distance for an object with an abrupt change in curvature (i.e., an edge). Average prediction error is 0.44 ± 0.12%. <bold>(C)</bold>
Equation 17 (prediction using curvature) is used to predict radial distance for the same object as in <bold>(B)</bold>
. Average prediction error is 1.05 ± 5.12%. In both <bold>(B)</bold>
and <bold>(C)</bold>
, the inset enlarges the area around the edge.</p>
</caption>
<graphic xlink:href="fnbot-06-00009-g0006"></graphic>
</fig>
<p>In Figure <xref ref-type="fig" rid="F6">6A</xref>
, local object slope and local object curvature were both used to make predictions about future contact points on an object that contained several gradual changes in curvature. Predictions using both slope and curvature were reasonably accurate over the object surface, with prediction errors of 6.37 ± 6.81% for prediction using local object slope and 3.02 ± 1.52% for prediction using local object curvature. In this first example, there is a clear advantage to choosing prediction using local object curvature. This simulation illustrates that prediction based on local object curvature is more accurate than prediction based on local object slope when curvature changes gradually.</p>
<p>The second test object (Figures <xref ref-type="fig" rid="F6">6B,C</xref>
) had a location at which curvature abruptly changed—that is, an edge. Figure <xref ref-type="fig" rid="F6">6B</xref>
shows that prediction using local object slope (Equation 16) acts similarly to a low pass filter with respect to change in curvature, resulting in a relatively accurate prediction. Figure <xref ref-type="fig" rid="F6">6C</xref>
, in contrast, shows that prediction using local object curvature (Equation 17) was accurate until the abrupt change was reached, at which point there was a spike in the absolute percent error of the prediction. The prediction error of 0.44 ± 0.12% for prediction using local object slope was lower than the prediction error of 1.05 ± 5.12% for prediction using local object curvature.</p>
<p>In summary, these simulation results demonstrate that local object curvature more accurately predicts future contact points on regions of objects with no distinct edges, but that when objects have distinct edges, prediction using local object slope is more accurate. Of course, this in turn raises the question of what it means for an object to have a “distinct edge.” Mathematically, it must be an edge in the sense that there is a discontinuity in the curvature between measurements, which is clearly related to the spatial scale of the object relative to the spacing of the whiskers. We investigate this in the next section.</p>
</sec>
<sec><title>Importance of whisker spacing</title>
<p>The spacing between the whiskers on the object surface places limits on the maximum curvature that can be sensed. Equation 19 defines κ<sub>max</sub>
, the maximum discriminable curvature:
<disp-formula id="E19"><label>(19)</label>
<mml:math id="M19"><mml:mrow><mml:msub><mml:mi>κ</mml:mi>
<mml:mrow><mml:mi>max</mml:mi>
</mml:mrow>
</mml:msub>
<mml:mo>=</mml:mo>
<mml:mfrac><mml:mn>1</mml:mn>
<mml:mi>r</mml:mi>
</mml:mfrac>
<mml:mo>=</mml:mo>
<mml:mfrac><mml:mn>1</mml:mn>
<mml:mrow><mml:mi>d</mml:mi>
<mml:mo>+</mml:mo>
<mml:mi>Δ</mml:mi>
</mml:mrow>
</mml:mfrac>
</mml:mrow>
</mml:math>
</disp-formula>
where <italic>r</italic>
is the radius of the osculating circle defining κ<sub>max</sub>
, <italic>d</italic>
is the vibrissa spacing, and Δ is an arbitrarily small distance.</p>
<p>In the present work, we assumed that the spacing between the whiskers on the object surface was approximately equal to the spacing between them at their base. This is a reasonable approximation for the present work, in which the whiskers are parallel to each other, but is unlikely to be valid for the real rat.</p>
<p>Figure <xref ref-type="fig" rid="F7">7A</xref>
illustrates the relationship expressed in Equation 19. The distance Δ is added to the vibrissa spacing because a force must be applied to the vibrissae to find a contact point. The limiting case is finding the curvature of a cylinder with radius <italic>r</italic>
and Δ = 0. With vibrissae spaced at <italic>d</italic>
= <italic>r</italic>
, the object could only apply a force to bend at most two of the vibrissae. In order to make a discrete curvature approximation, a minimum of three contact points are required to define curvature. Therefore, Δ must be strictly greater than zero if the measurement of curvature is desired.</p>
<fig id="F7" position="float"><label>Figure 7</label>
<caption><p><bold>Effect of vibrissal spacing</bold>
. <bold>(A)</bold>
Maximum curvature discriminable by a given whisker spacing. <bold>(B)</bold>
Prediction of radial distance on different curvature scales with 1 cm whisker spacing. The simulated object is shown in black, the starting positions of the vibrissae in blue, and the predicted contact points in red. The length of the spiral on the left is five times longer than the length of the spiral on the right. <bold>(C)</bold>
Quantification of the increased prediction error as the scale of the object decreases relative to inter-vibrissal spacing. Whisker spacing is normalized by the length of the object. As relative vibrissal spacing increases, error increases linearly.</p>
</caption>
<graphic xlink:href="fnbot-06-00009-g0007"></graphic>
</fig>
<p>To demonstrate the effect of relative vibrissa spacing on prediction error, prediction was simulated over hyperbolic spirals of various sizes. The hyperbolic spiral was chosen as the test object because it can be translated past the vibrissa array in such a way that curvature decreases approximately linearly. In these simulations, the multiple-vibrissa prediction method was used, with vibrissa spacing set to 1 cm. The size of the spiral test object was decreased for each case to illustrate the effect of relative vibrissa spacing.</p>
<p>Figure <xref ref-type="fig" rid="F7">7</xref>
shows the simulated test object on two different length scales, as vibrissa spacing stays constant. The left side of Figure <xref ref-type="fig" rid="F7">7B</xref>
shows an object large on the scale of inter-vibrissa spacing, while the right side of Figure <xref ref-type="fig" rid="F7">7B</xref>
shows an object small on the scale of inter-vibrissa spacing. Figure <xref ref-type="fig" rid="F7">7C</xref>
illustrates that prediction error increases as the test object decreases in size. This increase in error is unsurprising, and occurs for two reasons. First, the relative change in distance between the most forward measurement and the predicted radial distance is more pronounced as the object decreases in size. More importantly, the spacing between vibrissae defines the resolution of the array, and it is decreasing relative to the change in curvature that is occurring. This simulation illustrates the importance of vibrissa spacing to prediction—though gradual curvature changes can be accurately predicted with good spatial resolution, prediction suffers when resolution decreases.</p>
</sec>
<sec><title>Hardware results: validation of the translational sweep algorithm</title>
<p>We next aimed to validate these simulation results in hardware. However, before we could do so, we needed to experimentally validate the translational sweep algorithm proposed by Solomon and Hartmann (<xref ref-type="bibr" rid="B14">2010</xref>
). We implemented the translational sweep algorithm on our hardware array of whiskers (see <italic>Methods</italic>
) to extract the contour of an object as it was translated past one or more vibrissae in the array. Figure <xref ref-type="fig" rid="F8">8</xref>
shows results from a trial in which a 2.5 cm diameter cylinder was translated past a single vibrissa at a velocity of 2 cm/s. The maximum difference between the actual object position and the estimated contact point at any given time was 0.1 mm, within the limits of measurement error.</p>
<fig id="F8" position="float"><label>Figure 8</label>
<caption><p><bold>Radial distance estimation, in hardware, using a translational sweeping algorithm to calculate radial distance</bold>
. Contour extraction was performed as a 2.5 cm diameter cylinder was translated past a single whisker. The estimated data points (blue) are plotted over a solid line (black) indicating the actual profile of the cylinder. The maximum difference between actual object position and the estimated contact point was 0.1 mm.</p>
</caption>
<graphic xlink:href="fnbot-06-00009-g0008"></graphic>
</fig>
</sec>
<sec><title>Hardware results: implementation of prediction with a single vibrissa: object of constant curvature</title>
<p>Having validated the translational sweep algorithm, we next aimed to test the two prediction methods in hardware. Figure <xref ref-type="fig" rid="F2">9A</xref>
presents the same contour extraction data as in Figure <xref ref-type="fig" rid="F8">8</xref>
, but here we also apply the prediction algorithms. Specifically, Figure <xref ref-type="fig" rid="F9">9A</xref>
shows the contact points prediction using local object slope (Equation 16) and prediction using local object curvature (Equation 17). These predictions are plotted over a curve representing the actual surface of the cylinder. Using different numbers of past time steps did not significantly affect the accuracy of the prediction, which stayed fixed at an average level of 1.3 ± 1.25% for prediction using local object slope, and an average level of 1.1 ± 0.96% for prediction using local object curvature (Figure <xref ref-type="fig" rid="F9">9B</xref>
). Prediction error was calculated according to Equation 18. Because there was no difference between numbers of past time steps used, five points were used for the rest of the single-vibrissa experiments presented in this paper. In the second part of this experiment, cylinders with diameters of 2.5 cm, 4.4 cm, 5.0 cm, 6.3 cm, and 10 cm were passed by the array at a velocity of 2 cm/s. As expected, there is no significant effect of object diameter on prediction error. The error across the trials for prediction using local object curvature was 1.40 ± 1.43%.</p>
<fig id="F9" position="float"><label>Figure 9</label>
<caption><p><bold>(A)</bold>
Predicted radial distance plotted over a solid line indicating the actual profile of the cylinder. Predicted radial distances use local object curvature (blue) or local object slope (red). <bold>(B)</bold>
Prediction error as the object diameter increases. There is no statistical difference between errors (<italic>p</italic>
>0.05).</p>
</caption>
<graphic xlink:href="fnbot-06-00009-g0009"></graphic>
</fig>
</sec>
<sec><title>Hardware implementation of prediction with multiple vibrissae: object of constant curvature</title>
<p>Neurons in the trigeminal nuclei have receptive fields that include multiple vibrissae, which may enable the rat to estimate the surface gradient at a single time point. For this technique to be viable, the chosen vibrissae must all be touching the object at once. The spacing between adjacent vibrissae in the final design of the array (Figure <xref ref-type="fig" rid="F3">3</xref>
) is 1.5 cm. To ensure there were times when all five vibrissae touched the test object concurrently, only the 10 cm diameter cylinder was used for these constant curvature trials. Figure <xref ref-type="fig" rid="F10">10</xref>
shows the predicted future contact points for the vibrissa array as the array moves forward. Each predicted point is 1.5 cm further along the object than the lead vibrissa was at the time of the point's prediction. Since the five points of contact come from five different vibrissae, the predicted curvature gradient is implemented over a much larger spatial scale. Small errors in distance estimation result in larger deviations in the predicted future radial distance estimate.</p>
<fig id="F10" position="float"><label>Figure 10</label>
<caption><p><bold>Predicted radial distance using multiple whiskers</bold>
. The predicted future contact points (red) line up very well with the actual surface of the cylinder (black line). Prediction error is 1.13 ± 1.2%. Each different color corresponds to contact points from separate whiskers.</p>
</caption>
<graphic xlink:href="fnbot-06-00009-g0010"></graphic>
</fig>
</sec>
<sec><title>Hardware implementation of prediction with a single vibrissa: object with abrupt curvature change</title>
<p>The results of the previous two sections show that prediction using local object curvature can accurately predict future contact points for an object with constant curvature. In the world, however, such objects are rarely found. We did not implement prediction using the multiple vibrissa method on this object because the main difference between the spatial scales over which we were making abrupt changes was better represented by the single vibrissa method.</p>
<p>To show the effect of abrupt changes in object curvature on prediction, a simple case was examined. Figure <xref ref-type="fig" rid="F11">11A</xref>
shows the test object. The object has three distinct constant curvatures with no smoothing transition from one to the next. The radii of curvature for the sections were 2.5 cm, 3.2 cm, and 2.2 cm. The object was moved past the vibrissa array using linear actuation at a velocity of 2 cm/s. Prediction was performed using local object curvature for each vibrissa, with predicted contact points shown in Figure <xref ref-type="fig" rid="F11">11B</xref>
.</p>
<fig id="F11" position="float"><label>Figure 11</label>
<caption><p><bold>Prediction of future contact points demonstrated in hardware using an object with abruptly changing curvatures</bold>
. <bold>(A)</bold>
Test object, consisting of three circles placed in a row. The curvature of each circle is indicated; the curvatures at which the circles join is very high and was not quantified exactly. <bold>(B)</bold>
Predicted contact points mapped onto the test object. At the transition between curvatures, the absolute percent error of the prediction increases substantially. <bold>(C)</bold>
Absolute percent error of the prediction for each of the predicted data points.</p>
</caption>
<graphic xlink:href="fnbot-06-00009-g0011"></graphic>
</fig>
<p>It can be seen from Figure <xref ref-type="fig" rid="F11">11C</xref>
that the absolute percent error of the prediction remains small during the first section of constant curvature. At the transition to the second curvature, the absolute percent error increases, with the maximum value more than quadrupling the prediction error during the first section. Once the vibrissa has been able to sense the second curvature for a short time, absolute percent error returns to baseline. The second transition is similar to the first. A closer examination of Figure <xref ref-type="fig" rid="F11">11B</xref>
shows fewer predicted points during the times when the algorithm is least accurate. The reason for this is that the vibrissa slips quickly over the concavity in the object, covering the distance more quickly than during slip-free data collection. This longitudinal slip causes a significant increase in error in the estimation of distance.</p>
</sec>
<sec><title>Hardware implementation of prediction with multiple vibrissae: object with gradual curvature change</title>
<p>We tested the hardware vibrissa array with a section of a hyperbolic spiral that had an approximately linear decrease in curvature as the object was translated past the whiskers.</p>
<p>Figure <xref ref-type="fig" rid="F12">12</xref>
shows the estimate of predicted future radial distance when the vibrissa array was passed by an object with gradually changing curvature. Figure <xref ref-type="fig" rid="F12">12A</xref>
shows the actual object. Figure <xref ref-type="fig" rid="F12">12B</xref>
shows a trial using the single vibrissa method, which corresponds to the situation where spacing between the data points is small relative to the change in curvature. The prediction error of 0.97 ± 1.4% is very similar to the error for an object with constant curvature (1.1 ± 0.96%). In Figure <xref ref-type="fig" rid="F12">12C</xref>
, the vibrissa base points were evenly spaced at 1.5 cm intervals, and the multiple vibrissa method was used. This increase in spacing mirrored the decrease in size of the object in the simulations, and resulted in an increase in prediction error. Since the gradual change in curvature is from high curvature to lower curvature, the predicted future contact points lie mostly inside the actual curve. Prediction error for this trial was 12.7 ± 7.11%, though the error decreases to 11.9 ± 6.97% when the largest outlier is removed.</p>
<fig id="F12" position="float"><label>Figure 12</label>
<caption><p><bold>Hardware prediction on an object with gradually changing curvature</bold>
. <bold>(A)</bold>
Picture of the test object, designed to be a close approximation to a hyperbolic spiral. The whiskers translated along the bottom face of the object from left to right as shown by the arrow. <bold>(B)</bold>
Spacing of contact points is small relative to object size, resulting in a prediction error of 0.97 ± 1.4%. <bold>(C)</bold>
Spacing of contact points is large relative to object size, yielding a prediction error of 12.7 ± 7.11%.</p>
</caption>
<graphic xlink:href="fnbot-06-00009-g0012"></graphic>
</fig>
</sec>
</sec>
<sec sec-type="discussion" id="s4"><title>Discussion</title>
<p>This paper has demonstrated that simple algorithms can be used to predict future contact points on an object. Prediction is accurate for objects that have constant and/or gradually changing curvature as long as the distance between vibrissae is small relative to the change in curvature. Abrupt changes in object curvature result in jumps in absolute percent error of the prediction.</p>
<sec><title>Prediction algorithm performance</title>
<p>Two different algorithms for prediction were described in the results section. Prediction using local object slope is only accurate when the curvature being measured does not change much between estimated contact points, but it can accommodate for abrupt changes in curvature (e.g., an edge). Prediction using local object curvature was shown to be more accurate for both objects with constant curvature and objects with gradual changes in curvature.</p>
<p>In all cases, vibrissa spacing makes a difference in accuracy of prediction. This result is hardly surprising, since the limiting factor is essentially sensor resolution. The main advantage of widely spaced vibrissae is the ability to predict further ahead in space. Since information about the sensed object is spread over a wider distance, it is more likely that the estimated curvature will be a reflection of the overall curvature of the object rather than a measurement of a local deviation from the actual object curvature.</p>
<p>These observations lead to the hypothesis that vibrissa spacing represents a trade-off between accuracy and predictive utility. For wall following, we anticipate that the rat will protract its vibrissae far forward and maximize spacing between the tips, because predictive sensing over a large spatial scale is important. For edge detection tasks, accuracy becomes more important so we anticipate that the vibrissal tips will be spaced more closely together.</p>
</sec>
<sec><title>A computational mechanism for the instant detection of motion</title>
<p>Motion detection, as well as the ability to distinguish self-movement from environmental movement, is critical to animal survival. Behaviors such as escape or predation must link motion detection to immediate motor action. For these behaviors, the quality of the sensory data obtained is largely irrelevant, as long as it is sufficient to trigger the appropriate motor action. We suggest that a mismatch between predicted and actual sensory input may serve to direct attention.</p>
<p>In this work, we have presented specific examples of how calculating terms of the total derivative might be used by a moving rat to track an object within its vibrissal sensory array. If an object is moving in the vibrissal field, there will be a mismatch between actual and predicted input that is exactly equal to how the world is changing in time. In the next time step, the animal can use this mismatch to compute the relative velocity between its own movements and movements in the world. In other words, the animal can compare predicted and actual sensory data obtained to estimate the quantity <inline-formula><mml:math id="M27"><mml:mrow><mml:mfrac><mml:mrow><mml:mi>δ</mml:mi>
<mml:msub><mml:mi>A</mml:mi>
<mml:mrow><mml:mi>e</mml:mi>
<mml:mi>n</mml:mi>
<mml:mi>v</mml:mi>
</mml:mrow>
</mml:msub>
</mml:mrow>
<mml:mrow><mml:mi>δ</mml:mi>
<mml:mi>t</mml:mi>
</mml:mrow>
</mml:mfrac>
</mml:mrow>
</mml:math>
</inline-formula>
. Of course, if the fluctuations in the environment (i.e., movements of objects in the world) are unpredictable, then the animal will never succeed in finding an accurate estimate. Because objects on the scale of the rat are strongly dominated by inertial forces, however, many changes in the world will have predictable temporal trajectories (e.g., a rolling tin can).</p>
</sec>
<sec><title>Advantages of using prediction during wall following behavior</title>
<p>During wall-following behavior, a rat maintains a small separation between itself and the wall while traveling at a relatively high velocity. The rat can maintain this separation even when walls curve, however, since the rat has mass, and it moves at a high velocity, changing direction takes time and energy. Following a curving wall would be easier if the rat could predict the future wall profile using its vibrissae. More specifically, if a rat could use just radial distance measures to predict the upcoming wall contour, it could start to change direction sooner, reducing inertial delays and saving energy. Encoding by its vibrissa array to determine where the wall was likely to be in the future, it would save energy and allow the rat to travel along the wall at a higher velocity. With these prediction algorithms that prediction could be accomplished at a very low level of processing. The algorithms presented here suggest that this type of prediction could be achieved with a very low level of computation.</p>
</sec>
<sec><title>Possible improvements in vibrissa sensing/prediction</title>
<p>An examination of the results presented in Figure <xref ref-type="fig" rid="F11">11</xref>
shows predicted data points that are spaced much less densely in the concave regions of the object. Data are less dense in these sections because the vibrissa slips, and because only the tip of the vibrissa contacts during part of the movement. When the vibrissa tip is the only part of the vibrissa that contacts the object, radial distance cannot be accurately calculated with our algorithm. For artificial whiskers like the ones presented in this work, these sorts of tip contacts can occur at several radial distances near the full whisker length. In order to calculate radial distance for tip contacts, we need a measure of the axial force being applied to the vibrissa tip, where axial force is defined along the axis of the vibrissa. Future versions of the vibrissa array presented in this paper will be able to sense axial force along with bending moments at the vibrissa base.</p>
<p>The artificial whiskers used in this work were cylindrical, but real rat whiskers taper linearly. Tapering the whisker confers at least two advantages. First, whisker taper increases sensitivity to small contact forces (Williams and Kramer, <xref ref-type="bibr" rid="B19">2010</xref>
; Solomon and Hartmann, <xref ref-type="bibr" rid="B15">2011</xref>
). Second, when used in conjunction with an axial force sensor (not used in the present work), a tapered whisker ensures that the mappings between bending moment and axial force are one-to-one with radial distance and θ<sub><italic>push</italic>
</sub>
, the angle through which the whisker has rotated against the object (Solomon and Hartmann, <xref ref-type="bibr" rid="B15">2011</xref>
).</p>
</sec>
<sec><title>Conflict of interest statement</title>
<p>The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.</p>
</sec>
</sec>
</body>
<back><ack><p>This work was funded by NSF award IOS-0818414 and NSF CAREER award IOS-0846088 to Mitra J. Z. Hartmann and NSF EFRI-0938007 (Liu, PI). Christopher L. Schroeder was sponsored by NSF IGERT # DGE-0903637: Integrative Research in Motor Control and Movement (Hale, PI).</p>
</ack>
<ref-list><title>References</title>
<ref id="B1"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Barron</surname>
<given-names>J. L.</given-names>
</name>
<name><surname>Fleet</surname>
<given-names>D. J.</given-names>
</name>
<name><surname>Beauchemin</surname>
<given-names>S. S.</given-names>
</name>
</person-group>
(<year>1994</year>
). <article-title>Performance of optical flow techniques</article-title>
. <source>Int. J. Comput. Vis</source>
. <volume>12</volume>
, <fpage>43</fpage>
–<lpage>77</lpage>
</mixed-citation>
</ref>
<ref id="B2"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Beauchemin</surname>
<given-names>S. S.</given-names>
</name>
<name><surname>Barron</surname>
<given-names>J. L.</given-names>
</name>
</person-group>
(<year>1995</year>
). <article-title>The computation of optical flow</article-title>
. <source>ACM Comput. Surv</source>
. <volume>27</volume>
, <fpage>433</fpage>
–<lpage>467</lpage>
</mixed-citation>
</ref>
<ref id="B3"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Berg</surname>
<given-names>R. W.</given-names>
</name>
<name><surname>Kleinfeld</surname>
<given-names>D.</given-names>
</name>
</person-group>
(<year>2003</year>
). <article-title>Rhythmic whisking by rat: retraction as well as protraction of the vibrissae is under active muscular control</article-title>
. <source>J. Neurophysiol</source>
. <volume>89</volume>
, <fpage>104</fpage>
–<lpage>117</lpage>
<pub-id pub-id-type="doi">10.1152/jn.00600.2002</pub-id>
<pub-id pub-id-type="pmid">12522163</pub-id>
</mixed-citation>
</ref>
<ref id="B4"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Bicchi</surname>
<given-names>A.</given-names>
</name>
<name><surname>Scilingo</surname>
<given-names>E. P.</given-names>
</name>
<name><surname>Ricciardi</surname>
<given-names>E.</given-names>
</name>
<name><surname>Pietrini</surname>
<given-names>P.</given-names>
</name>
</person-group>
(<year>2008</year>
). <article-title>Tactile flow explains haptic counterparts of common visual illusions</article-title>
. <source>Brain Res. Bull</source>
. <volume>75</volume>
, <fpage>737</fpage>
–<lpage>741</lpage>
<pub-id pub-id-type="doi">10.1016/j.brainresbull.2008.01.011</pub-id>
<pub-id pub-id-type="pmid">18394519</pub-id>
</mixed-citation>
</ref>
<ref id="B5"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Birdwell</surname>
<given-names>J. A.</given-names>
</name>
<name><surname>Solomon</surname>
<given-names>J. H.</given-names>
</name>
<name><surname>Thajchayapong</surname>
<given-names>M.</given-names>
</name>
<name><surname>Taylor</surname>
<given-names>M. A.</given-names>
</name>
<name><surname>Cheely</surname>
<given-names>M.</given-names>
</name>
<name><surname>Towal</surname>
<given-names>R. B.</given-names>
</name>
<name><surname>Conradt</surname>
<given-names>J.</given-names>
</name>
<name><surname>Hartmann</surname>
<given-names>M. J. Z.</given-names>
</name>
</person-group>
(<year>2007</year>
). <article-title>Biomechanical models for radial distance detection by rat vibrissae</article-title>
. <source>J. Neurophsiol</source>
. <volume>98</volume>
, <fpage>2439</fpage>
–<lpage>2455</lpage>
<pub-id pub-id-type="doi">10.1152/jn.00707.2006</pub-id>
<pub-id pub-id-type="pmid">17553946</pub-id>
</mixed-citation>
</ref>
<ref id="B6"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Gopal</surname>
<given-names>V.</given-names>
</name>
<name><surname>Hartmann</surname>
<given-names>M. J. Z.</given-names>
</name>
</person-group>
(<year>2007</year>
). <article-title>Using hardware models to quantify sensory data acquisition across the rat vibrissal array</article-title>
. <source>Bioinspir. Biomim</source>
. <volume>2</volume>
, <fpage>S135</fpage>
–<lpage>S145</lpage>
<pub-id pub-id-type="doi">10.1088/1748-3182/2/4/S03</pub-id>
<pub-id pub-id-type="pmid">18037723</pub-id>
</mixed-citation>
</ref>
<ref id="B7"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Hartmann</surname>
<given-names>M. J. Z.</given-names>
</name>
</person-group>
(<year>2009</year>
). <article-title>Active touch, exploratory movements, and sensory prediction</article-title>
. <source>Integr. Comp. Biol</source>
. <volume>49</volume>
, <fpage>681</fpage>
–<lpage>690</lpage>
<pub-id pub-id-type="doi">10.1093/icb/icp107</pub-id>
<pub-id pub-id-type="pmid">21665850</pub-id>
</mixed-citation>
</ref>
<ref id="B9"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Horn</surname>
<given-names>B. K. P.</given-names>
</name>
<name><surname>Schunck</surname>
<given-names>B. G.</given-names>
</name>
</person-group>
(<year>2003</year>
). <article-title>Determining optical flow</article-title>
. <source>Artif. Intell</source>
. <volume>17</volume>
, <fpage>185</fpage>
–<lpage>203</lpage>
</mixed-citation>
</ref>
<ref id="B9a"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Kaneko</surname>
<given-names>M.</given-names>
</name>
<name><surname>Kanayama</surname>
<given-names>N.</given-names>
</name>
<name><surname>Tsuji</surname>
<given-names>T.</given-names>
</name>
</person-group>
(<year>1998</year>
). <article-title>Active antenna for contact sensing</article-title>
. <source>IEEE Trans. Rob. Autom</source>
. <volume>14</volume>
, <fpage>278</fpage>
–<lpage>291</lpage>
</mixed-citation>
</ref>
<ref id="B10"><mixed-citation publication-type="book"><person-group person-group-type="author"><name><surname>Munson</surname>
<given-names>B. R.</given-names>
</name>
<name><surname>Young</surname>
<given-names>D. F.</given-names>
</name>
<name><surname>Okiishi</surname>
<given-names>T. H.</given-names>
</name>
<name><surname>Huebsch</surname>
<given-names>W. W.</given-names>
</name>
</person-group>
(<year>2009</year>
). <source>Fundamentals of Fluid Mechanics</source>
. <publisher-loc>Hoboken, NJ</publisher-loc>
: <publisher-name>John Wiley and Sons, Inc</publisher-name>
</mixed-citation>
</ref>
<ref id="B11"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Nemenman</surname>
<given-names>I.</given-names>
</name>
<name><surname>Lewen</surname>
<given-names>G. D.</given-names>
</name>
<name><surname>Bialek</surname>
<given-names>W.</given-names>
</name>
<name><surname>Van Steveninck</surname>
<given-names>R. R. D.</given-names>
</name>
</person-group>
(<year>2008</year>
). <article-title>Neural coding of natural stimuli: information at sub-millisecond resolution</article-title>
. <source>PLoS Comput. Biol</source>
. <volume>4</volume>
:<fpage>e1000025</fpage>
<pub-id pub-id-type="doi">10.1371/journal.pcbi.1000025</pub-id>
<pub-id pub-id-type="pmid">18369423</pub-id>
</mixed-citation>
</ref>
<ref id="B12"><mixed-citation publication-type="book"><person-group person-group-type="author"><name><surname>Scilingo</surname>
<given-names>E. P.</given-names>
</name>
<name><surname>Sgambelluri</surname>
<given-names>N.</given-names>
</name>
<name><surname>Bicchi</surname>
<given-names>A.</given-names>
</name>
</person-group>
(<year>2008</year>
). <article-title>The role of tactile flow in processing dynamic haptic stimuli</article-title>
in <source>Sense of Touch and its Rendering: Progress in Haptics Research Book Series</source>
, eds <person-group person-group-type="editor"><name><surname>Bicchi</surname>
<given-names>A.</given-names>
</name>
<name><surname>Buss</surname>
<given-names>M.</given-names>
</name>
<name><surname>Ernst</surname>
<given-names>M. O.</given-names>
</name>
<name><surname>Peer</surname>
<given-names>A.</given-names>
</name>
</person-group>
(<publisher-loc>Heidelberger, Berlin</publisher-loc>
: <publisher-name>Springer-Verlag Berlin</publisher-name>
), <fpage>39</fpage>
–<lpage>60</lpage>
</mixed-citation>
</ref>
<ref id="B13"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Solomon</surname>
<given-names>J. H.</given-names>
</name>
<name><surname>Hartmann</surname>
<given-names>M. J.</given-names>
</name>
</person-group>
(<year>2006</year>
). <article-title>Robotic whiskers used to sense features</article-title>
. <source>Nature</source>
<volume>443</volume>
, <fpage>525</fpage>
<pub-id pub-id-type="doi">10.1038/443525a</pub-id>
<pub-id pub-id-type="pmid">17024083</pub-id>
</mixed-citation>
</ref>
<ref id="B13a"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Solomon</surname>
<given-names>J. H.</given-names>
</name>
<name><surname>Hartmann</surname>
<given-names>M. J. Z.</given-names>
</name>
</person-group>
(<year>2008</year>
). <article-title>Artificial whiskers suitable for array implementation: accounting for lateral slip and surface friction</article-title>
. <source>IEEE Trans. Rob</source>
. <volume>24</volume>
, <fpage>1157</fpage>
–<lpage>1167</lpage>
</mixed-citation>
</ref>
<ref id="B14"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Solomon</surname>
<given-names>J. H.</given-names>
</name>
<name><surname>Hartmann</surname>
<given-names>M. J. Z.</given-names>
</name>
</person-group>
(<year>2010</year>
). <article-title>Extracting object contours with the sweep of a robotic whisker using torque information.</article-title>
. <source>Int. J. Rob. Res</source>
. <volume>29</volume>
, <fpage>1233</fpage>
–<lpage>1245</lpage>
</mixed-citation>
</ref>
<ref id="B15"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Solomon</surname>
<given-names>J. H.</given-names>
</name>
<name><surname>Hartmann</surname>
<given-names>M. J. Z.</given-names>
</name>
</person-group>
(<year>2011</year>
). <article-title>Radial distance determination in the rat vibrissal system and the effects of Weber's law</article-title>
. <source>Philos. Trans. R. Soc. Lond. B Biol. Sci</source>
. <volume>366</volume>
, <fpage>3049</fpage>
–<lpage>3057</lpage>
<pub-id pub-id-type="doi">10.1098/rstb.2011.0166</pub-id>
<pub-id pub-id-type="pmid">21969686</pub-id>
</mixed-citation>
</ref>
<ref id="B16"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Szwed</surname>
<given-names>M.</given-names>
</name>
<name><surname>Bagdasarian</surname>
<given-names>K.</given-names>
</name>
<name><surname>Ahissar</surname>
<given-names>E.</given-names>
</name>
</person-group>
(<year>2003</year>
). <article-title>Encoding of vibrissal active touch</article-title>
. <source>Neuron</source>
<volume>40</volume>
, <fpage>621</fpage>
–<lpage>630</lpage>
<pub-id pub-id-type="doi">10.1016/S0896-6273(03)00671-8</pub-id>
<pub-id pub-id-type="pmid">14642284</pub-id>
</mixed-citation>
</ref>
<ref id="B18"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Welker</surname>
<given-names>W. I.</given-names>
</name>
</person-group>
(<year>1964</year>
). <article-title>Analysis of sniffing of the albino rat</article-title>
. <source>Behaviour</source>
<volume>22</volume>
, <fpage>223</fpage>
–<lpage>244</lpage>
</mixed-citation>
</ref>
<ref id="B19"><mixed-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Williams</surname>
<given-names>C. M.</given-names>
</name>
<name><surname>Kramer</surname>
<given-names>E. M.</given-names>
</name>
</person-group>
(<year>2010</year>
). <article-title>The advantages of a tapered whisker</article-title>
. <source>PLoS ONE</source>
<volume>5</volume>
:<fpage>e8806</fpage>
<pub-id pub-id-type="doi">10.1371/journal.pone.0008806</pub-id>
<pub-id pub-id-type="pmid">20098714</pub-id>
</mixed-citation>
</ref>
</ref-list>
</back>
</pmc>
<affiliations><list><country><li>États-Unis</li>
</country>
</list>
<tree><country name="États-Unis"><noRegion><name sortKey="Schroeder, Christopher L" sort="Schroeder, Christopher L" uniqKey="Schroeder C" first="Christopher L." last="Schroeder">Christopher L. Schroeder</name>
</noRegion>
<name sortKey="Hartmann, Mitra J Z" sort="Hartmann, Mitra J Z" uniqKey="Hartmann M" first="Mitra J. Z." last="Hartmann">Mitra J. Z. Hartmann</name>
<name sortKey="Hartmann, Mitra J Z" sort="Hartmann, Mitra J Z" uniqKey="Hartmann M" first="Mitra J. Z." last="Hartmann">Mitra J. Z. Hartmann</name>
</country>
</tree>
</affiliations>
</record>
Pour manipuler ce document sous Unix (Dilib)
EXPLOR_STEP=$WICRI_ROOT/Ticri/CIDE/explor/HapticV1/Data/Ncbi/Merge
HfdSelect -h $EXPLOR_STEP/biblio.hfd -nk 002304 | SxmlIndent | more
Ou
HfdSelect -h $EXPLOR_AREA/Data/Ncbi/Merge/biblio.hfd -nk 002304 | SxmlIndent | more
Pour mettre un lien sur cette page dans le réseau Wicri
{{Explor lien |wiki= Ticri/CIDE |area= HapticV1 |flux= Ncbi |étape= Merge |type= RBID |clé= PMC:3477675 |texte= Sensory prediction on a whiskered robot: a tactile analogy to “optical flow” }}
Pour générer des pages wiki
HfdIndexSelect -h $EXPLOR_AREA/Data/Ncbi/Merge/RBID.i -Sk "pubmed:23097641" \ | HfdSelect -Kh $EXPLOR_AREA/Data/Ncbi/Merge/biblio.hfd \ | NlmPubMed2Wicri -a HapticV1
![]() | This area was generated with Dilib version V0.6.23. | ![]() |