• search hit 18 of 27
Back to Result List

ReCSAI: recursive compressed sensing artificial intelligence for confocal lifetime localization microscopy

Please always quote using this URN: urn:nbn:de:bvb:20-opus-299768
  • Background Localization-based super-resolution microscopy resolves macromolecular structures down to a few nanometers by computationally reconstructing fluorescent emitter coordinates from diffraction-limited spots. The most commonly used algorithms are based on fitting parametric models of the point spread function (PSF) to a measured photon distribution. These algorithms make assumptions about the symmetry of the PSF and thus, do not work well with irregular, non-linear PSFs that occur for example in confocal lifetime imaging, where a laserBackground Localization-based super-resolution microscopy resolves macromolecular structures down to a few nanometers by computationally reconstructing fluorescent emitter coordinates from diffraction-limited spots. The most commonly used algorithms are based on fitting parametric models of the point spread function (PSF) to a measured photon distribution. These algorithms make assumptions about the symmetry of the PSF and thus, do not work well with irregular, non-linear PSFs that occur for example in confocal lifetime imaging, where a laser is scanned across the sample. An alternative method for reconstructing sparse emitter sets from noisy, diffraction-limited images is compressed sensing, but due to its high computational cost it has not yet been widely adopted. Deep neural network fitters have recently emerged as a new competitive method for localization microscopy. They can learn to fit arbitrary PSFs, but require extensive simulated training data and do not generalize well. A method to efficiently fit the irregular PSFs from confocal lifetime localization microscopy combining the advantages of deep learning and compressed sensing would greatly improve the acquisition speed and throughput of this method. Results Here we introduce ReCSAI, a compressed sensing neural network to reconstruct localizations for confocal dSTORM, together with a simulation tool to generate training data. We implemented and compared different artificial network architectures, aiming to combine the advantages of compressed sensing and deep learning. We found that a U-Net with a recursive structure inspired by iterative compressed sensing showed the best results on realistic simulated datasets with noise, as well as on real experimentally measured confocal lifetime scanning data. Adding a trainable wavelet denoising layer as prior step further improved the reconstruction quality. Conclusions Our deep learning approach can reach a similar reconstruction accuracy for confocal dSTORM as frame binning with traditional fitting without requiring the acquisition of multiple frames. In addition, our work offers generic insights on the reconstruction of sparse measurements from noisy experimental data by combining compressed sensing and deep learning. We provide the trained networks, the code for network training and inference as well as the simulation tool as python code and Jupyter notebooks for easy reproducibility.show moreshow less

Download full text files

Export metadata

Additional Services

Share in Twitter Search Google Scholar Statistics
Metadaten
Author: Sebastian Reinhard, Dominic A. Helmerich, Dominik Boras, Markus Sauer, Philip Kollmannsberger
URN:urn:nbn:de:bvb:20-opus-299768
Document Type:Journal article
Faculties:Fakultät für Biologie / Theodor-Boveri-Institut für Biowissenschaften
Fakultät für Biologie / Center for Computational and Theoretical Biology
Language:English
Parent Title (English):BMC Bioinformatics
Year of Completion:2022
Volume:23
Issue:1
Article Number:530
Source:BMC Bioinformatics 2022, 23(1):530. DOI: 10.1186/s12859-022-05071-5
DOI:https://doi.org/10.1186/s12859-022-05071-5
Dewey Decimal Classification:0 Informatik, Informationswissenschaft, allgemeine Werke / 00 Informatik, Wissen, Systeme / 004 Datenverarbeitung; Informatik
5 Naturwissenschaften und Mathematik / 57 Biowissenschaften; Biologie / 570 Biowissenschaften; Biologie
Tag:AI; FLIMbee; SMLM; compressed sensing; dSTORM
Release Date:2023/04/05
EU-Project number / Contract (GA) number:835102)
OpenAIRE:OpenAIRE
Collections:Open-Access-Publikationsfonds / Förderzeitraum 2022
Licence (German):License LogoCC BY: Creative-Commons-Lizenz: Namensnennung 4.0 International