Abstract Background Pathophysiological mechanisms underlying sex-based differences in diabetes remain poorly understood. Mitochondrial metabolite methylmalonic acid (MMA) accumulation reflects mitochondrial dysfunction which is involved in sex-specific pathophysiological responses biologically. We aimed to investigate the sex-specific associations between mortality risk and MMA in adults with the presence or absence of type 2 diabetes. Methods This cohort study included 24,164 adults (12,123 females and 12,041 males) from the NHANES study during 1999–2014. Both sexes were separately categorized as those with no diabetes, prediabetes, undiagnosed diabetes, and diagnosed diabetes. Circulating MMA level was measured at baseline by mass-spectrometric detection. Mortality status was ascertained from baseline until December 31, 2015. Results During a median follow-up of 11.1 years, 3375 deaths were documented. Males had a particularly higher mortality than females in adults with diagnosed diabetes compared to differences in those with no diabetes, prediabetes and undiagnosed diabetes (sex differences in mortality rate per 1000 person-years across diabetic status: 0.62, 1.44, 5.78, and 9.77, p