It has been generally assumed that partner's erectile dysfunction, premature, and delayed ejaculation play a significant role in determining female sexual dysfunction (FSD). This study aimed to evaluate the role of the male partner's sexual function, as perceived by women, in determining FSD. A consecutive series of 156 heterosexual women consulting our clinic for FSD was retrospectively studied. All patients underwent a structured interview and completed the Female Sexual Function Index (FSFI). FSFI total score decreased as a function of partner's age, conflicts within the couple, relationship without cohabitation and the habit of engaging in intercourse to please the partner; FSFI total score increased as a function of frequency of intercourse, attempts to conceive and fertility-focused intercourse. FSFI total score showed a negative, stepwise correlation with partner's perceived hypoactive sexual desire (HSD) (r = -0.327; p < 0.0001), whereas no significant correlation was found between FSFI and erectile dysfunction, premature and delayed ejaculation. In an age-adjusted model, partner's HSD was negatively related to FSFI total score (Wald = 9.196, p = 0.002), arousal (Wald = 7.893, p = 0.005), lubrication (Wald = 5.042, p = 0.025), orgasm (Wald = 9.293, p = 0.002), satisfaction (Wald = 12.764, p < 0.0001), and pain (Wald = 6.492, p = 0.011) domains. Partner's HSD was also significantly associated with somatized anxiety, low frequency of intercourse, low partner's care for the patient's sexual pleasure, and with a higher frequency of masturbation, even after adjusting for age. In patients not reporting any reduction in libido, FSFI total score was significantly lower when their partner's libido was low (p = 0.041); the correlation disappeared if the patient also experienced HSD. In conclusion, the presence of erectile dysfunction, premature, and delayed ejaculation of the partner may not act as a primary contributing factor to FSD, as determined by FSFI scores; conversely, women's sexuality seems to be mostly impaired by the perceived reduction in their partner's sexual interest.