Cognitive impairment is a common disabling symptom in PD. Unlike motor symptoms, the mechanism underlying cognitive dysfunction in Parkinson’s disease (PD) remains unclear and may involve multiple pathophysiological processes. Resting state functional magnetic resonance imaging (rs-fMRI) is a fast-developing research field, and its application in cognitive impairments in PD is rapidly growing. In this review, we summarize rs-fMRI studies on cognitive function in PD and discuss the strong potential of rs-fMRI in this area. rs-fMRI can help reveal the pathophysiology of cognitive symptoms in PD, facilitate early identification of PD patients with cognitive impairment, distinguish PD dementia from dementia with Lewy bodies, and monitor and guide treatment for cognitive impairment in PD. In particular, ongoing and future longitudinal studies would enhance the ability of rs-fMRI in predicting PD dementia. In combination with other modalities such as positron emission tomography, rs-fMRI could give us more information on the underlying mechanism of cognitive deficits in PD.