Abstract Background Previous research suggests that sarcopenia is associated with lower cognitive functioning. Evidence on the longitudinal relationship between cognition and sarcopenia, according to the revised criteria of the European Working Group on Sarcopenia in Older People (EWGSOP2), is scarce. This study aimed to investigate both cross‐sectional and longitudinal associations between sarcopenia and its defining parameters (muscle strength, muscle mass and physical performance) and cognitive performance in middle‐aged and older men. Methods This was a secondary analysis of data from the European Male Ageing Study (EMAS), a multicentre cohort study of men aged 40–79 years, recruited from population registers in eight European centres. Cognitive functioning was assessed by using a battery of three neuropsychological tests, measuring fluid intelligence: Rey–Osterrieth Complex Figure (ROCF‐Copy and ROCF‐Recall), Camden Topographical Recognition Memory (CTRM) and Digit Symbol Substitution Test (DSST). Sarcopenia‐defining parameters appendicular lean mass (aLM), gait speed (GS), chair stand test (CST) and handgrip strength (HGS) were measured. Sarcopenia was diagnosed according to the criteria of the EWGSOP2. All measurements were performed at baseline and after a follow‐up of 4.3 years. Cross‐sectional associations between cognition, sarcopenia‐defining parameters and prevalent sarcopenia (EWGSOP2) were analysed. Longitudinally, the predictive value of baseline cognition on decline in sarcopenia‐defining parameters, onset of new sarcopenia and vice versa was examined. Linear and logistic regression were used and adjusted for putative confounders. Results In the whole cohort (n = 3233), ROCF‐Copy (β = 0.016; P