Seminar: Beyond Variational Model and Self-Similarity in Super-Resolution: Unfolding Models and Multi-Heat Attention

Date: Thursday, 22nd of February, 15:00

Speaker: Iván Pereira

Title: Beyond Variational Model and Self-Similarity in Super-Resolution: Unfolding Models and Multi-Heat Attention

Abstract:

Classical variational methods for solving image processing problems are more interpretable and flexible than pure deep learning approaches, but their performance is limited by the use of rigid priors. Deep unfolding networks combine the strengths of both by unfolding the steps of the optimization algorithm used to estimate the minimizer of an energy functional into a deep learning framework. In this paper, we propose an unfolding approach to extend a variational model exploiting self-similarity of natural images in the data fidelity term for single-image super-resolution. The proximal, downsampling and upsampling operators are written in terms of a neural network specifically designed for each purpose. Moreover, we include a new multi-head attention module to replace the nonlocal term in the original formulation. A comprehensive evaluation covering a wide range of sampling factors and noise realizations proves the benefits of the proposed unfolding techniques. The model shows to better preserve image geometry while being robust to noise.