By combining atomistic simulations with a detailed analysis of individual atomic hops, we show that the diffusion of carbon in a binary Fe-C glass exhibits strong (anti-)correlations and is largely determined by the local environment. Higher local carbon concentrations lead to slower atomic mobility. Our results help explain the increasing stability of Fe-C (and other similar metal-metalloid glasses) against crystallization with increasing carbon concentration.