The rodent whisker system is widely used as a model system for investigating sensorimotor integration, neural mechanisms of complex cognitive tasks, neural development, and robotics. The whisker pathways to the barrel cortex have received considerable attention. However, many subcortical structures are paramount to the whisker system. They contribute to important processes, like filtering out salient features, integration with other senses, and adaptation of the whisker system to the general behavioral state of the animal. We present here an overview of the brain regions and their connections involved in the whisker system. We do not only describe the anatomy and functional roles of the cerebral cortex, but also those of subcortical structures like the striatum, superior colliculus, cerebellum, pontomedullary reticular formation, zona incerta, and anterior pretectal nucleus as well as those of level setting systems like the cholinergic, histaminergic, serotonergic, and noradrenergic pathways. We conclude by discussing how these brain regions may affect each other and how they together may control the precise timing of whisker movements and coordinate whisker perception.