Pre-existing T cell memory provides substantial protection against viral, bacterial, and parasitic infections. The generation of protective T cell memory constitutes a primary goal for cell-mediated vaccines, thus understanding the mechanistic basis of memory development and maintenance are of major importance. The widely accepted idea that T cell memory pools are directly descended from the effector populations has been challenged by recent reports that provide evidence for the early establishment of T cell memory and suggest that the putative memory precursor T cells do not undergo full expansion to effector status. Moreover, it appears that once the memory T cells are established early in life, they can persist for the lifetime of an individual. This is in contrast to the reported waning of naïve T cell immunity with age. Thus, in the elderly, immune memory that was induced at an early age may be more robust than recently induced memory, despite the necessity for long persistence. The present review discusses the mechanisms underlying the early establishment of immunological memory and the subsequent persistence of memory T cell pools in animal models and humans.