Allocation of finite resources to separate reproductive functions is predicted to vary across environments and affect fitness. Biomass is the most commonly measured allocation currency; however, in comparison with nutrients it may be less limited and express different environmental and evolutionary responses. Here, we measured carbon, nitrogen, phosphorus, and biomass allocation among floral whorls in recombinant inbred lines of Brassica rapa in multiple environments to characterize the genetic architecture of floral allocation, including its sensitivity to environmental heterogeneity and to choice of currency. Mass, carbon, and nitrogen allocation to female whorls (pistils and sepals) decreased under high density, whereas nitrogen allocation to male organs (stamens) decreased under drought. Phosphorus allocation decreased by half in pistils under drought, while stamen phosphorus was unaffected by environment. While the contents of each currency were positively correlated among whorls, selection to improve fitness through female (or male) function typically favored increased allocation to pistils (or stamens) but decreased allocation to other whorls. Finally, genomic regions underlying correlations among allocation metrics were mapped, and loci related to nitrogen uptake and floral organ development were located within mapped quantitative trait loci. Our candidate gene identification suggests that nutrient uptake may be a limiting step in maintaining male allocation. Taken together, allocation to male vs female function is sensitive to distinct environmental stresses, and the choice of currency affects the interpretation of floral allocation responses to the environment. Further, genetic correlations may counter the evolution of allocation patterns that optimize fitness through female or male function.