A fundamental problem faced by the brain is to estimate whether a touched object is rigidly attached to a ground reference or is movable. A simple solution to this problem would be for the brain to test whether pushing on the object with a limb is accompanied by limb displacement. The mere act of pushing excites large populations of mechanoreceptors, generating a sensory response that is only weakly sensitive to limb displacement if the movements are small, and thus can hardly be used to determine the mobility of the object. In the mechanical world, displacement or deformation of objects frequently co-occurs with microscopic fluctuations associated with the frictional sliding of surfaces in contact or with micro-failures inside an object. In this study, we provide compelling evidence that the brain relies on these microscopic mechanical events to estimate the displacement of the limb in contact with an object, and hence the mobility of the touched object. We show that when pressing with a finger on a stiff surface, fluctuations that resemble the mechanical response of granular solids provoke a sensation of limb displacement. Our findings suggest that when acting on an external object, prior knowledge about the sensory consequences of interacting with the object contributes to proprioception.