During postnatal development, sensory experience modulates cortical development, inducing numerous changes in all of the components of the cortex. Most of the cortical changes thus induced occur during the critical period, when the functional and structural properties of cortical neurons are particularly susceptible to alterations. Although the time course for experience-mediated sensory development is specific for each system, postnatal development acts as a whole, and if one cortical area is deprived of its normal sensory inputs during early stages, it will be reorganized by the nondeprived senses in a process of cross-modal plasticity that not only increases performance in the remaining senses when one is deprived, but also rewires the brain allowing the deprived cortex to process inputs from other senses and cortices, maintaining the modular configuration. This paper summarizes our current understanding of sensory systems development, focused specially in the visual system. It delineates sensory enhancement and sensory deprivation effects at both physiological and anatomical levels and describes the use of enriched environment as a tool to rewire loss of brain areas to enhance other active senses. Finally, strategies to apply restorative features in human-deprived senses are studied, discussing the beneficial and detrimental effects of cross-modal plasticity in prostheses and sensory substitution devices implantation.