Skip to Main content Skip to Navigation
Journal articles

A deep learning model to predict RNA-Seq expression of tumours from whole slide images

Abstract : Deep learning methods for digital pathology analysis are an effective way to address multiple clinical questions, from diagnosis to prediction of treatment outcomes. These methods have also been used to predict gene mutations from pathology images, but no comprehensive evaluation of their potential for extracting molecular features from histology slides has yet been performed. We show that HE2RNA, a model based on the integration of multiple data modes, can be trained to systematically predict RNA-Seq profiles from whole-slide images alone, without expert annotation. Through its interpretable design, HE2RNA provides virtual spatialization of gene expression, as validated by CD3- and CD20-staining on an independent dataset. The transcriptomic representation learned by HE2RNA can also be transferred on other datasets, even of small size, to increase prediction performance for specific molecular phenotypes. We illustrate the use of this approach in clinical diagnosis purposes such as the identification of tumors with microsatellite instability.
Complete list of metadata

Cited literature [69 references]  Display  Hide  Download
Contributor : Myriam Bodescot Connect in order to contact the contributor
Submitted on : Monday, September 28, 2020 - 3:03:10 PM
Last modification on : Wednesday, November 3, 2021 - 5:37:42 AM
Long-term archiving on: : Tuesday, December 29, 2020 - 6:13:41 PM


Publication funded by an institution




Benoît Schmauch, Alberto Romagnoni, Elodie Pronier, Charlie Saillard, Pascale Maillé, et al.. A deep learning model to predict RNA-Seq expression of tumours from whole slide images. Nature Communications, Nature Publishing Group, 2020, 11 (1), pp.3877. ⟨10.1038/s41467-020-17678-4⟩. ⟨inserm-02951135⟩



Record views


Files downloads