Effects of annealing after/under iron (Fe) ion irradiation on deuterium (D) retention behavior in tungsten (W) were studied. The D2 TDS spectra as a function of heating temperature for 0.1dpa damaged W showed that the D retention was clearly decreased as the annealing temperature was increased. In particular, the desorption of D trapped by voids was largely reduced by annealing at 1173K. The TEM observation indicated that the size of dislocation loops was clearly grown, and its density was decreased by the annealing above 573K. After annealing at 1173K, almost all the dislocation loops were recovered. The results of positron annihilation spectroscopy suggested that the density of vacancy-type defects such as voids, was decreased as the annealing temperature was increased, while its size was increased, indicating that the D retention was reduced by the recovery of the voids. Furthermore, it was found that the desorption temperature of D trapped by the voids for damaged W above 0.3dpa was shifted toward higher temperature side. These results lead to a conclusion that the D retention behavior is controlled by defect density. The D retention in the samples annealed during irradiation was less than that annealed after irradiation. This result shows that defects would be quickly annihilated before stabilization by annealing during irradiation.