Herpes simplex virus type 1 (HSV-1) is a neuroinvasive human pathogen that has the ability to infect and replicate within epithelial cells and neurons and establish a life-long latent infection in sensory neurons. HSV-1 depends on the host cellular cytoskeleton for entry, replication, and exit. Therefore, HSV-1 has adapted mechanisms to promote its survival by exploiting the microtubule and actin cytoskeletons to direct its active transport, infection, and spread between neurons and epithelial cells during primary and recurrent infections. This review will focus on the currently known mechanisms utilized by HSV-1 to harness the neuronal cytoskeleton, molecular motors, and the secretory and exocytic pathways for efficient virus entry, axonal transport, replication, assembly, and exit from the distinct functional compartments (cell body and axon) of the highly polarized sensory neurons.