Although combinatorial antiretroviral therapy (cART) potently suppresses the virus, a sterile or functional cure still remains one of the greatest therapeutic challenges worldwide. Reservoirs are infected cells that can maintain HIV persistence for several years in patients with optimal cART, which is a leading obstacle to eradicate the virus. Despite the significant progress that has been made in our understanding of the diversity of cells that promote HIV persistence, many aspects that are critical to the development of effective therapeutic approaches able to purge the latent CD4+ T cell reservoir are poorly understood. Simultaneous purging strategies known as “kick-kill” have been pointed out as promising therapeutic approaches to eliminate the viral reservoir. However, long-term outcomes of purging strategies as well as the effect on the HIV reservoir are still largely fragmented. In this context, mathematical modeling can provide a rationale not only to evaluate the impact on the HIV reservoir but also to facilitate the formulation of hypotheses about potential therapeutic strategies. This review aims to discuss briefly the most recent mathematical modeling contributions, harnessing our knowledge toward the uncharted territory of HIV eradication. In addition, problems associated with current models are discussed, in particular, mathematical models consider only T cell responses but HIV control may also depend on other cell responses as well as chemokines and cytokines dynamics.