Keywords :
Time of Flight; Data enhancement; Depth Map; Depth measurements; Frame rate; Low resolution; Multi-camera rigs; Multimodal sensor; Sensor fusion; Space and time; Spatial domains; Spatio-temporal; Spatio-temporal data; Temporal domain; ToF cameras; Video frame; Cameras; Image processing; Sensors; Sensor data fusion
Abstract :
[en] We propose an extension of our previous work on spatial domain Time-of-Flight (ToF) data enhancement to the temporal domain. Our goal is to generate enhanced depth maps at the same frame rate of the 2-D camera that, coupled with a ToF camera, constitutes a hybrid ToF multi-camera rig. To that end, we first estimate the motion between consecutive 2-D frames, and then use it to predict their corresponding depth maps. The enhanced depth maps result from the fusion between the recorded 2-D frames and the predicted depth maps by using our previous contribution on ToF data enhancement. The experimental results show that the proposed approach overcomes the ToF camera drawbacks; namely, low resolution in space and time and high level of noise within depth measurements, providing enhanced depth maps at video frame rate. © 2012 IEEE.
Garcia, F.; SnT - Universtity of Luxembourg, Luxembourg
Aouada, D.; SnT - Universtity of Luxembourg, Luxembourg
Mirbach, B.; Advanced Engineering - IEE S.A., Luxembourg
OTTERSTEN, Björn ;
University of Luxembourg > Interdisciplinary Centre for Security, Reliability and Trust (SNT)
Scopus citations®
without self-citations
2