The four endemic human coronaviruses HCoV-229E, -NL63, -OC43, and -HKU1 contribute a considerable share of upper and lower respiratory tract infections in adults and children. While their clinical representation resembles that of many other agents of the common cold, their evolutionary histories, and host associations could provide important insights into the natural history of past human pandemics. For two of these viruses, we have strong evidence suggesting an origin in major livestock species while primordial associations for all four viruses may have existed with bats and rodents. HCoV-NL63 and -229E may originate from bat reservoirs as assumed for many other coronaviruses, but HCoV-OC43 and -HKU1 seem more likely to have speciated from rodent-associated viruses. HCoV-OC43 is thought to have emerged from ancestors in domestic animals such as cattle or swine. The bovine coronavirus has been suggested to be a possible ancestor, from which HCoV-OC43 may have emerged in the context of a pandemic recorded historically at the end of the 19th century. New data suggest that HCoV-229E may actually be transferred from dromedary camels similar to Middle East respiratory syndrome (MERS) coronavirus. This scenario provides important ecological parallels to the present prepandemic pattern of host associations of the MERS coronavirus.