Denoising Noise2Noise with multiple noisy copies (2D SEM data)
Details
This example demonstrates how a denoiser can be trained when only noisy data is available. Please note that this example uses the so-called Noise2Noise training, requiring two noisy versions of the exact same field of view to be available.
Noise2Noise was first proposed by Lehtinen et al. and states that multiple noisy observations of the same structure are sufficient to train content aware image restoration networks. This means that we can replace the ground truth target images with additional noisy acquisitions. This opens the door to many new applications where the acquisition of ground truth data is impossible or very time-consuming.
Note: If you happen to have the possibility to acquire pairs of noisy and clean (ground truth) images, we recommended to use such clean data by training a supervised denoiser. For this, please have a look at the 2D denoising scenario.
Credits
The data was acquired by Réza Shahidi and Gáspár Jékely at University of Exeter and originates from this publication: Content-aware image restoration for electron microscopy by Tim-Oliver Buchholz et al.
Demo
In this example a content aware image restoration network was trained on multiple fast scanned Scanning Electron Microscopy (SEM) images. The example notebook can be found here.