Immuno-oncology drugs (IODs) have revolutionized the treatment of some cancers. Although IODs are enabling some patients with cancer to become long-time survivors, only 30% to 40% respond to these drugs. There is experimental and clinical evidence that the gut microbiome may play a role in IOD response, leading to speculation that manipulation of the gut microenvironment might improve the response rate to IODs. We review the evidence relating to how gut microorganisms may affect response to IODs and discuss the implications of targeting the microbiome to improve IOD response, including the challenges to refine and translate the findings to practical clinical use.