This study aimed to quantitatively estimate the correlation between systemic inflammation with cognitive function, as well as glycemic and lipid profiles in patients with type 2 diabetes mellitus (T2DM). The PubMed, Web of Science, EMBASE, SCOPUS, CNKI, Wanfang, VIP, and CBM databases were searched from its inception until June 2023 (PROSPERO registration: CRD42022356889). We analyzed data extracted from observational studies to quantify the correlations (r) as the pooled effect size and further performed subgroup analyses and sensitivity analyses. A total of 32 studies involving 7,483 patients with T2DM were included. The findings revealed a significant moderate negative correlation between interleukin-6 (IL-6), tumor necrosis factor-alpha (TNF alpha), and C-reactive protein (CRP) levels with Montreal Cognitive Assessment scores. TNF-alpha levels also had moderate negative correlation with Mini-Mental State Examination scores. For glycemic and lipid profiles, there was a significant moderate positive correlation between CRP and TNF-alpha levels and glycated hemoglobin (HbA1c), and TNF-alpha levels were also found to be lowly positively correlated with fasting blood glucose (FBG). CRP levels were found to have a low positive correlation with total cholesterol (TC), and IL-6 levels were found to be lowly positively correlated with triglycerides. The results indicate that elevated levels of IL-6, CRP, and TNF-alpha are significantly associated with cognitive impairment in patients with T2DM and may serve as inflammatory markers for T2DM with mild cognitive impairment. The CRP and TNF-alpha levels were more strongly correlated with HbA1c than with FBG and TC. Further research is needed to determine the clinical value of these inflammatory biomarkers and to investigate potential causal mechanisms underlying this association.