Abstract Invasive lobular breast carcinoma (ILC) is the second most common breast carcinoma (BC) subtype and is mainly driven by loss of E‐cadherin expression. Correct classification of BC as ILC is important for patient treatment. This study assessed the degree of agreement among pathologists for the diagnosis of ILC. Two sets of hormone receptor (HR)‐positive/HER2‐negative BCs were independently reviewed by participating pathologists. In set A (61 cases), participants were provided with hematoxylin/eosin (HE)‐stained sections. In set B (62 cases), participants were provided with HE‐stained sections and E‐cadherin immunohistochemistry (IHC). Tumor characteristics were balanced. Participants classified specimens as non‐lobular BC versus mixed BC versus ILC. Pairwise inter‐observer agreement and agreement with a pre‐defined reference diagnosis were determined with Cohen's kappa statistics. Subtype calls were correlated with molecular features, including CDH1/E‐cadherin mutation status. Thirty‐five pathologists completed both sets, providing 4,305 subtype calls. Pairwise inter‐observer agreement was moderate in set A (median κ = 0.58, interquartile range [IQR]: 0.48–0.66) and substantial in set B (median κ = 0.75, IQR: 0.56–0.86, p