Paper published in a book (Scientific congresses, symposiums and conference proceedings)
Lightweight palm and finger tracking for real-time 3D gesture control
Hackenberg, Georg; McCall, Roderick; Broll, Wolfgang
2011In IEEE Conference on Virtual Reality 2011
Peer reviewed


Full Text
Publisher postprint (4.81 MB)

All documents in ORBilu are protected by a user license.

Send to


Abstract :
[en] We present a novel technique implementing barehanded interaction with virtual 3D content by employing a time-of-flight camera. The system improves on existing 3D multi-touch systems by working regardless of lighting conditions and supplying a working volume large enough for multiple users. Previous systems were limited either by environmental requirements, working volume, or computational resources necessary for realtime operation. By employing a time-of-flight camera, the system is capable of reliably recognizing gestures at the finger level in real-time at more than 50 fps with commodity computer hardware using our newly developed precision hand and finger-tracking algorithm. Building on this algorithm, the system performs gesture recognition with simple constraint modeling over statistical aggregations of the hand appearances in a working volume of more than 8 cubic meters. Two iterations of user tests were performed on a prototype system, demonstrating the feasibility and usability of the approach as well as providing first insights regarding the acceptance of true barehanded touch-based 3D interaction.
Disciplines :
Computer science
Identifiers :
Author, co-author :
Hackenberg, Georg;  Fraunhofer FIT
McCall, Roderick ;  Fraunhofer FIT
Broll, Wolfgang;  Fraunhofer FIT
Language :
Title :
Lightweight palm and finger tracking for real-time 3D gesture control
Publication date :
Event name :
Virtual Reality
Event place :
Singapore, Singapore
Event date :
19-23 March 2011
Main work title :
IEEE Conference on Virtual Reality 2011
Publisher :
Pages :
Peer reviewed :
Peer reviewed
Commentary :
IEEE VR 2011
Available on ORBilu :
since 06 September 2013


Number of views
45 (3 by Unilu)
Number of downloads
686 (0 by Unilu)

Scopus citations®
Scopus citations®
without self-citations


Similar publications

Contact ORBilu