In inflammatory diseases, macrophages are a main producer of a range of cytokines regulating the inflammatory state. This also includes inflammation induced by tumor growth, which recruits so-called tumor-associated macrophages supporting tumor growth. Macrophages are therefore relevant targets for cytotoxic or phenotype-modulating drugs in the treatment of inflammatory and cancerous diseases. Such targeting of macrophages has been tried using the natural propensity of macrophages to non-specifically phagocytose circulating foreign particulate material. In addition, the specific targeting of macrophage-expressed receptors has been used in order to obtain a selective uptake in macrophages and reduce adverse effects of off-target delivery of drugs. CD163 is a highly expressed macrophage-specific endocytic receptor that has been studied for intracellular delivery of small molecule drugs to macrophages using targeted liposomes or antibody drug conjugates. This review will focus on the biology of CD163 and its potential role as a target for selective macrophage targeting compared with other macrophage targeting approaches.