Abstract Background Intrahepatic cholangiocarcinoma (ICC) is a highly malignant neoplasm and characterized by desmoplastic matrix. The heterogeneity and crosstalk of tumor microenvironment remain incompletely understood. Methods To address this gap, we performed Weighted Gene Co-expression Network Analysis (WGCNA) to identify and construct a cancer associated fibroblasts (CAFs) infiltration biomarker. We also depicted the intercellular communication network and important receptor-ligand complexes using the single-cell transcriptomics analysis of tumor and Adjacent normal tissue. Results Through the intersection of TCGA DEGs and WGCNA module genes, 784 differential genes related to CAFs infiltration were obtained. After a series of regression analyses, the CAFs score was generated by integrating the expressions of EVA1A, APBA2, LRRTM4, GOLGA8M, BPIFB2, and their corresponding coefficients. In the TCGA-CHOL, GSE89748, and 107,943 cohorts, the high CAFs score group showed unfavorable survival prognosis (p