Reliable and optimal exploitation of rapidly developing airborne imaging methods requires geometric and radiometric quality assurance of production systems in operational conditions. Permanent test sites are the most promising approach for cost-efficient performance assessment. Optimal construction of permanent radiometric test sites for high resolution airborne imaging systems is an unresolved issue. The objective of this study was to assess the performance of commercially available gravels and painted and unpainted concrete targets for permanent, open-air radiometric test sites under sub-optimal climate conditions in Southern Finland. The reflectance spectrum and reflectance anisotropy and their stability were characterized during the summer of 2009. The management of reflectance anisotropy and stability were shown to be the key issues for better than 5% reflectance accuracy.