In recent years, flexible silica aerogels have gained significant attention, owing to their excellent thermal and acoustic insulation properties accompanied by mechanical flexibility. Fiber reinforcement of such aerogels results in a further enhancement of the strength and durability of the composite, while retaining the excellent insulation properties. In this paper, the influence of four different kinds of fibers within a flexible silica aerogel matrix is studied and reported. First, a description of the synthesis procedure and the resulting morphology of the four aerogel composites is presented. Their mechanical behavior under uniaxial quasi-static tension and compression is investigated, particularly their performance under uniaxial compression at different temperature conditions (50 °C, 0 °C, and -50 °C). The reinforcement of the flexible silica aerogels with four different fiber types only marginally influences the thermal conductivity but strongly enhances their mechanical properties.