The architectural protein CTCF is a mediator of chromatin conformation, but how CTCF binding to DNA is orchestrated to maintain long-range gene expression is poorly understood. Here we perform RNAi knockdown to reduce CTCF levels and reveal a shared subset of CTCF-bound sites are robustly resistant to protein depletion. The 'persistent' CTCF sites are enriched at domain boundaries and chromatin loops constitutive to all cell types. CRISPR-Cas9 deletion of 2 persistent CTCF sites at the boundary between a long-range epigenetically active (LREA) and silenced (LRES) region, within the Kallikrein (KLK) locus, results in concordant activation of all 8 KLK genes within the LRES region. CTCF genome-wide depletion results in alteration in Topologically Associating Domain (TAD) structure, including the merging of TADs, whereas TAD boundaries are not altered where persistent sites are maintained. We propose that the subset of essential CTCF sites are involved in cell-type constitutive, higher order chromatin architecture.