Skip to Main content Skip to Navigation
New interface
Preprints, Working Papers, ...

Fluorescence image deconvolution microscopy via generative adversarial learning (FluoGAN)

Mayeul Cachia 1 Vasiliki Stergiopoulou 1 Luca Calatroni 1 Sébastien Schaub 2, 1 Laure Blanc-Féraud 1 
1 MORPHEME - Morphologie et Images
CRISAM - Inria Sophia Antipolis - Méditerranée , IBV - Institut de Biologie Valrose : U1091, Laboratoire I3S - SIS - Signal, Images et Systèmes
Abstract : We propose FluoGAN, an unsupervised hybrid approach combining the physical modelling of fluorescence microscopy timelapse acquisitions with a Generative Adversarial Network (GAN) for the problem of image deconvolution. Differently from standard approaches combining a least-square data fitting term based on one (longtime exposure) image with sparsity-promoting regularisation terms, FluoGAN relies on a data fitting term defined as a distribution distance between the fluctuating observed timelapse (short-time exposure images) and the generative model. The distance between these two distributions is computed using adversarial training of two competing architectures: a physics-inspired generator simulating the fluctuation behaviour as a Poisson process of the observed images combined with blur and undersampling, and a standard convolutional discriminator. FluoGAN is a fully unsupervised approach requiring only a fluctuating sequence of blurred, undersampled and noisy images of the sample of interest as input and it can be complemented with prior knowledge on the desired solution such as sparsity, non-negativity etc. After having described in depth the main ideas behind FluoGAN, we formulate the corresponding optimisation problem and report several results on a simulated and real phantoms used by microscopy engineers to quantitatively assess spatial resolution. The comparison of FluoGAN with state-of-the-art methodologies shows unprecedented resolution and allows for high-precision reconstruction of very fine structures in challenging real Ostreopsis cf Ovata data.
Complete list of metadata

https://hal.archives-ouvertes.fr/hal-03790156
Contributor : Vasiliki Stergiopoulou Connect in order to contact the contributor
Submitted on : Wednesday, September 28, 2022 - 9:22:08 AM
Last modification on : Tuesday, October 25, 2022 - 4:19:05 PM

File

FluoGAN.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-03790156, version 1

Citation

Mayeul Cachia, Vasiliki Stergiopoulou, Luca Calatroni, Sébastien Schaub, Laure Blanc-Féraud. Fluorescence image deconvolution microscopy via generative adversarial learning (FluoGAN). {date}. ⟨hal-03790156⟩

Share

Metrics

Record views

74

Files downloads

29