[en] All existent methods for the statistical analysis of super–resolution approaches have stopped at the variance term, not accounting for the bias in the mean square error. In this paper we give an original derivation of the bias term. We propose to use a patch-based method inspired by the work of (Chatterjee and Milanfar, 2009). Our approach, however, is completely new as we derive a new affine bias model dedicated for the multi-frame super resolution framework. We apply the proposed statistical performance analysis to the Upsampling for Precise Super–Resolution (UP-SR) algorithm. This algorithm was shown experimentally to be a good solution for enhancing the resolution of depth sequences in both cases of global and local motions. Its performance is herein analyzed theoretically in terms of its approximated mean square error, using the proposed derivation of the bias. This analysis is validated experimentally on simulated static and dynamic depth sequences with a known ground truth. This provides an insightful understanding of the effects of noise variance, number of observed low resolution frames, and super–resolution factor on the final and intermediate performance of UP–SR. Our conclusion is that increasing the number of frames should improve the performance while the error is increased due to local motions, and to the upsampling which is part of UP-SR.
Disciplines :
Computer science
Author, co-author :
Aouada, Djamila ; University of Luxembourg > Interdisciplinary Centre for Security, Reliability and Trust (SNT)
Al Ismaeil, Kassem ; University of Luxembourg > Interdisciplinary Centre for Security, Reliability and Trust (SNT)
Ottersten, Björn ; University of Luxembourg > Interdisciplinary Centre for Security, Reliability and Trust (SNT)
External co-authors :
no
Language :
English
Title :
Patch-based Statistical Performance Analysis of Upsampling for Precise Super–Resolution
Publication date :
March 2015
Event name :
11th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISAPP)
Event date :
from 27-3-2015 to 29-03-2015
Audience :
International
Main work title :
11th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISAPP'15)
Beaulieu, N. and Jiang, S. (2010). Ml estimation of signal amplitude in laplace noise, . In Global Telecommunications Conference. IEEE.
Chatterjee, P. and Milanfar, P. (2009). Bias modeling for image denoising, . In 43rd Asilomar Conference on Signals, Systems and Computers.
Elad, M. and Feuer, A. (1999). Super-resolution reconstruction of continuous image sequences, . In Transaction Pattern Analysis and Machine Intelligence. IEEE.
Al Ismaeil, D., Aouada, B. M. B. O. (2013a). Depth super-resolution by enhanced shift & add, . In 15th International Conference on Computer Analysis of Images and Patterns. Springer.
Al Ismaeil, D., Aouada, B. M. B. O. (2013b). Dynamic super-resolution of depth sequences with nonrigid motions, . In 20th IEEE International Conference on Image Processing. IEEE.
Milanfar, P. (2010). Super-resolution imaging, . In CRC Press.
pmd CamBoard nano (2014). http://www.pmdtec.com/.
Rajagopalan, A. and Kiran, P. (2003). Motion-free superresolution and the role of relative blur, . In J. Opt. Soc. Amer.
Robinson, D. and Milanfar, P. (2003). Bias-minimizing filters for gradient-based motion estimation, . In 37th Asilomar Conference on Signals, Systems and Computers. IEEE.
Robinson, D. and Milanfar, P. (2006). Statistical performance analysis of super-resolution, . In Transaction Image Processing. IEEE.
Farsiu, D., Robinson, M. E. P. M. (2003). Robust shift and add approach to super-resolution, . In International symposium on Optical Science and Technology, SPIE's 48th Annual Meeting.
Farsiu, D., Robinson, M. E. P. M. (2004). Fast and robust multi-frame super-resolution, . In Transaction Image Processing. IEEE.
