Radiomics and 3D image features improve kidney cancer subtype classification

Complementary Roles of Radiomics and Foundation Representations in Renal Cell Carcinoma Classification: A Comparative Study of 2D and 3D CT Encodings

Computer Vision and Pattern RecognitionArtificial Intelligence

Summary

It is hard to tell different types of kidney cancer just by looking at CT scans before surgery. This study shows that combining detailed, handcrafted features called radiomics with advanced 3D image analysis gives better results than using either alone. The researchers tested several ways to combine these sources and found that using 3D data with a fusion method worked best. Their work suggests these two approaches together help doctors classify kidney tumors more accurately.

What this means in practice

  • For medical imaging teams: Improve classification of kidney cancer subtypes from CT scans by integrating radiomics with 3D foundation image features for better diagnostic support.
  • For clinical decision support developers: Build imaging tools that combine radiomics and pretrained 3D image encodings to enhance accuracy and interpretability in renal cancer diagnosis.

Authors

Yuan Liang, Sourav Bhattacharjee, Abraham Campbell

Abstract

Accurate preoperative subtype classification of renal cell carcinoma (RCC) from contrast-enhanced computed tomography remains clinically challenging. Radiomics provides structured tumour descriptors, whereas foundation representations offer transferable image features. However, it remains unclear whether radiomics still adds value beyond pretrained representations, and how 2D and 3D MedVAE encoders compare in this setting. We compared handcrafted radiomics, 2D MedVAE, 3D MedVAE, and their fusion for binary clear-cell RCC versus non-clear-cell RCC classification on KiTS23 under a unified preprocessing pipeline. Concatenation, cross-attention, and gated fusion were evaluated as representative integration strategies, and radiomics feature importance was analysed to support decision-centric interpretability. Fusion consistently improved discrimination over image-only MedVAE branches. The best overall performance was achieved by 3D gated fusion, with an AUC of 82.7\%, outperforming the best 2D fusion model (79.6%), the radiomics baseline (74.4%), and the single-modality MedVAE branches. Ablation analysis further showed clear gains of the full fusion model over both image-only and radiomics-only variants, indicating complementary contributions from radiomics and image representations. These findings suggest that radiomics remains relevant for RCC CT classification in the presence of foundation representations, and that its integration with MedVAE is more effective in the 3D setting. More broadly, the study supports a complementary role for radiomics and foundation representations in clinically meaningful imaging decision support.