To evaluate the safety of rice planting in cadmium geological anomaly areas, 41 natural soil, 479 paddy soil, and 432 rice samples were collected in southwestern Guangxi. The contents of Cd, Cu, Ni, and Zn and soil physical and chemical properties were measured. The single factor pollution index method () was used to evaluate the degree of contamination of the sample, and correlation analysis were used to explore the main factors affecting the heavy metal content in rice. The results showed that ① soil pH of the paddy field was 6.8; the organic matter content was 39.00 g·kg; the risk screening value was based on the soil environmental quality standards for soil pollution risk control and control of agricultural land (GB 15618-2018), the exceeding standard rates of Cd, Cu, Ni, and Zn in soil were 60.75%, 2.09%, 0.83%, and 1.88%. ② The over-standard rates of Cd and Ni in rice were 9.03% and 4.39%, respectively. Considering straw as raw material for feed and organic fertilizer, the corresponding over-standard rates of Cd were 6.94% and 1.16%. ③ Correlation analysis showed that soil pH, organic matter, total heavy metal, and available content were the main factors affecting the content of heavy metals in rice. Cd and Ni in the study area all exhibited certain over-standard phenomena, and the low-accumulation rice varieties could be planted to reduce heavy metal content in rice.