TY - GEN
T1 - Accurate Spatial Gene Expression Prediction by Integrating Multi-Resolution Features
AU - Chung, Youngmin
AU - Ha, Ji Hun
AU - Im, Kyeong Chan
AU - Lee, Joo Sang
N1 - Publisher Copyright:
© 2024 IEEE.
PY - 2024
Y1 - 2024
N2 - Recent advancements in Spatial Transcriptomics (ST) technology have facilitated detailed gene expression anal-ysis within tissue contexts. However, the high costs and methodological limitations of ST necessitate a more ro-bust predictive model. In response, this paper introduces TRIPLEX, a novel deep learning framework designed to predict spatial gene expression from Whole Slide Images (WSIs). TRIPLEX uniquely harnesses multi-resolution features, capturing cellular morphology at individual spots, the local context around these spots, and the global tissue organization. By integrating these features through an ef-fective fusion strategy, TRIPLEX achieves accurate gene ex-pression prediction. Our comprehensive benchmark study, conducted on three public ST datasets and supplemented with Visium data from 10X Genomics, demonstrates that TRIPLEX outperforms current state-of-the-art models in Mean Squared Error (MSE), Mean Absolute Error (MAE), and Pearson Correlation Coefficient (PCC). The model's predictions align closely with ground truth gene expression profiles and tumor annotations, underscoring TRIPLEX's potential in advancing cancer diagnosis and treatment.
AB - Recent advancements in Spatial Transcriptomics (ST) technology have facilitated detailed gene expression anal-ysis within tissue contexts. However, the high costs and methodological limitations of ST necessitate a more ro-bust predictive model. In response, this paper introduces TRIPLEX, a novel deep learning framework designed to predict spatial gene expression from Whole Slide Images (WSIs). TRIPLEX uniquely harnesses multi-resolution features, capturing cellular morphology at individual spots, the local context around these spots, and the global tissue organization. By integrating these features through an ef-fective fusion strategy, TRIPLEX achieves accurate gene ex-pression prediction. Our comprehensive benchmark study, conducted on three public ST datasets and supplemented with Visium data from 10X Genomics, demonstrates that TRIPLEX outperforms current state-of-the-art models in Mean Squared Error (MSE), Mean Absolute Error (MAE), and Pearson Correlation Coefficient (PCC). The model's predictions align closely with ground truth gene expression profiles and tumor annotations, underscoring TRIPLEX's potential in advancing cancer diagnosis and treatment.
KW - Compuational Patology
KW - Multi-Resolution Feature
KW - Spatial Transcriptomics
UR - https://www.scopus.com/pages/publications/85212780424
U2 - 10.1109/CVPR52733.2024.01101
DO - 10.1109/CVPR52733.2024.01101
M3 - Conference contribution
AN - SCOPUS:85212780424
T3 - Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition
SP - 11591
EP - 11600
BT - Proceedings - 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2024
PB - IEEE Computer Society
T2 - 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2024
Y2 - 16 June 2024 through 22 June 2024
ER -