Computer-aided colorectal cancer diagnosis: AI-driven image segmentation and classification

Colorectal cancer is an enormous health concern since it is among the most lethal types of malignancy. The manual examination has its limitations, including subjectivity and data overload. To overcome these challenges, computer -aided diagnostic systems focusing on image segmentation and abnormality classi fi cation have been developed. This study presents a two -stage approach for the automatic detection of fi ve types of colorectal abnormalities in addition to a control group: polyp, low-grade intraepithelial neoplasia, high-grade intraepithelial neoplasia, serrated adenoma, adenocarcinoma. In the fi rst stage, UNet3+ was used for image segmentation to locate the anomalies, while in the second stage, the Cross -Attention Multi -Scale Vision Transformer deep learning model was used to predict the type of anomaly after highlighting the anomaly on the raw images. In anomaly segmentation, UNet3+ achieved values of 0.9872, 0.9422, 0.9832, and 0.9560 for Dice Coef fi cient, Jaccard Index, Sensitivity, Speci fi city respectively. In anomaly detection, the Cross -Attention Multi -Scale Vision Transformer model attained a classi fi cation performance of 0.9340, 0.9037, 0.9446, 0.8723, 0.9102, 0.9849 for accuracy, F1 score, precision, recall, Matthews correlation coef fi cient, and speci fi city, respectively. The proposed approach proves its capacity to alleviate the overwhelm of pathologists and enhance the accuracy of colorectal cancer diagnosis by achieving high performance in both the identi fi cation of anomalies and the segmentation of regions.