With the widespread application of wireless sensor networks, large-scale systems with high sampling rates are becoming more and more common. The amount of original data generated by the wireless sensor network is very large, and transmitting all the original data back to the host wastes network bandwidth and energy. This paper proposes a wireless transmission method for large data based on hierarchical compressed sensing and sparse decomposition. This method includes a hierarchical signal decomposition method based on the same sparse basis and different sparse basis hierarchical compressed sensing method with a mask. Compared with the traditional compressed sensing method, this method reduces the error of signal reconstruction, reduces the amount of calculation during signal reconstruction, and reduces the occupation of hardware resources. We designed comparison experiments between the traditional compressed sensing algorithm and the method proposed in this article. In addition, the experiments’ results prove that our proposed method reduces the execution time, as well as the reconstruction error, compared with the traditional compressed sensing algorithm, and it can achieve better reconstruction at a relatively low compression ratio.