The cause of polycystic ovary syndrome (PCOS) is unknown, but androgen excess is a key feature. We combined a hyperandrogenized PCOS mouse model with global and tissue- and cell-specific androgen-resistant mouse lines to uncover the sites of androgen action that initiate PCOS. We demonstrate that direct androgen actions, particularly in neurons but less so in granulosa cells, are required for the development of key reproductive and metabolic PCOS features. These data highlight the previously overlooked importance of extraovarian neuroendocrine androgen action in the origins of PCOS. Targeting androgen-driven mechanisms may represent new options for developing a mechanism-based treatment of PCOS.