Skip to Main content Skip to Navigation
Journal articles

A deep learning model to predict RNA-Seq expression of tumours from whole slide images

Abstract : Deep learning methods for digital pathology analysis are an effective way to address multiple clinical questions, from diagnosis to prediction of treatment outcomes. These methods have also been used to predict gene mutations from pathology images, but no comprehensive evaluation of their potential for extracting molecular features from histology slides has yet been performed. We show that HE2RNA, a model based on the integration of multiple data modes, can be trained to systematically predict RNA-Seq profiles from whole-slide images alone, without expert annotation. Through its interpretable design, HE2RNA provides virtual spatialization of gene expression, as validated by CD3- and CD20-staining on an independent dataset. The transcriptomic representation learned by HE2RNA can also be transferred on other datasets, even of small size, to increase prediction performance for specific molecular phenotypes. We illustrate the use of this approach in clinical diagnosis purposes such as the identification of tumors with microsatellite instability.
Complete list of metadata

Cited literature [69 references]  Display  Hide  Download

https://www.hal.inserm.fr/inserm-02951135
Contributor : Myriam Bodescot <>
Submitted on : Monday, September 28, 2020 - 3:03:10 PM
Last modification on : Tuesday, February 16, 2021 - 11:58:04 AM
Long-term archiving on: : Tuesday, December 29, 2020 - 6:13:41 PM

File

s41467-020-17678-4.pdf
Publication funded by an institution

Identifiers

Collections

Citation

Benoît Schmauch, Alberto Romagnoni, Elodie Pronier, Charlie Saillard, Pascale Maillé, et al.. A deep learning model to predict RNA-Seq expression of tumours from whole slide images. Nature Communications, Nature Publishing Group, 2020, 11 (1), pp.3877. ⟨10.1038/s41467-020-17678-4⟩. ⟨inserm-02951135⟩

Share

Metrics

Record views

100

Files downloads

125