Reference : Real-Time Enhancement of Dynamic Depth Videos with Non-Rigid Deformations
Scientific journals : Article
Engineering, computing & technology : Computer science
http://hdl.handle.net/10993/28586
Real-Time Enhancement of Dynamic Depth Videos with Non-Rigid Deformations
English
Al Ismaeil, Kassem [University of Luxembourg > Interdisciplinary Centre for Security, Reliability and Trust (SNT)]
Aouada, Djamila mailto [University of Luxembourg > Interdisciplinary Centre for Security, Reliability and Trust (SNT) > >]
Solignac, Thomas []
Mirbach, Bruno []
Ottersten, Björn mailto [University of Luxembourg > Interdisciplinary Centre for Security, Reliability and Trust (SNT) > >]
27-Oct-2016
IEEE Transactions on Pattern Analysis & Machine Intelligence
IEEE
39
10
2045-2059
Yes (verified by ORBilu)
International
0162-8828
[en] Depth enhancement ; super-resolution ; non-rigid deformations ; bilateral total variation
[en] We propose a novel approach for enhancing depth videos containing non-rigidly deforming objects. Depth sensors are capable of capturing depth maps in real-time but suffer from high noise levels and low spatial resolutions. While solutions for reconstructing 3D details in static scenes, or scenes with rigid global motions have been recently proposed, handling unconstrained non-rigid deformations in relative complex scenes remains a challenge. Our solution consists in a recursive dynamic multi-frame superresolution algorithm where the relative local 3D motions between consecutive frames are directly accounted for. We rely on the assumption that these 3D motions can be decoupled into lateral motions and radial displacements. This allows to perform a simple local per-pixel tracking where both depth measurements and deformations are dynamically optimized. The geometric smoothness is subsequently added using a multi-level L1 minimization with a bilateral total variation regularization. The performance of this method is thoroughly evaluated on both real and synthetic data. As compared to alternative approaches, the results show a clear improvement in reconstruction accuracy and in robustness to noise, to relative large non-rigid deformations, and to topological changes. Moreover, the proposed approach, implemented on a CPU, is shown to be computationally efficient and working in real-time.
Researchers ; Professionals ; Students
http://hdl.handle.net/10993/28586
10.1109/TPAMI.2016.2622698
http://ieeexplore.ieee.org/document/7723916/
FnR ; FNR1204105 > Bjorn Ottersten > FAVE > Fusion Approaches for Visual systems Enhancement – security applications > 01/01/2012 > 31/12/2014 > 2011

File(s) associated to this reference

Fulltext file(s):

FileCommentaryVersionSizeAccess
Open access
AlIsmaeiletal_PAMI_SuperResolution.pdfPublisher postprint1.71 MBView/Open

Additional material(s):

File Commentary Size Access
Open access
Result_On_Face_Video.mp43.35 MBView/Open
Open access
Result_On_Cluttered_Video.mp43.19 MBView/Open

Bookmark and Share SFX Query

All documents in ORBilu are protected by a user license.