Glycosylation is recognised as a vitally important posttranslational modification. The structure of glycans that decorate proteins and lipids is largely dictated by biosynthetic reactions occurring in the Golgi apparatus. This biosynthesis relies on the relative distribution of glycosyltransferases and glycosidases, which is maintained by retrograde vesicle traffic between Golgi cisternae. Tethering of vesicles at the Golgi apparatus prior to fusion is regulated by Rab GTPases, coiled-coil tethers termed golgins and the multisubunit tethering complex known as the conserved oligomeric Golgi (COG) complex. In this review we discuss the mechanisms involved in vesicle tethering at the Golgi apparatus and highlight the importance of tethering in the context of glycan biosynthesis and a set of diseases known as congenital disorders of glycosylation.