Deformation-Based Abnormal Motion Detection using 3D Skeletons

Baptista, Renato; Demisse, Girum; Aouada, Djamila; Ottersten, Björn

Download

Paper published in a book (Scientific congresses, symposiums and conference proceedings)

Deformation-Based Abnormal Motion Detection using 3D Skeletons

Baptista, Renato; Demisse, Girum; Aouada, Djamila et al.

2018 • In IEEE International Conference on Image Processing Theory, Tools and Applications (IPTA)

Peer reviewed

Permalink
https://hdl.handle.net/10993/37097

Files (1)Send to Details Statistics Bibliography Similar publications

Files

Full Text

postauthor_IPTA_Baptista.pdf

Author postprint (457.73 kB)

Download

All documents in ORBilu are protected by a user license.

Send to

RIS BibTex APA Chicago Permalink X Linkedin

Details

Keywords :

Temporal Analysis; Abnormal Detection; Deformation

Abstract :

[en] In this paper, we propose a system for abnormal motion detection using 3D skeleton information, where the abnormal motion is not known a priori. To that end, we present a curve-based representation of a sequence, based on few joints of a 3D skeleton, and a deformation-based distance function. We further introduce a time-variation model that is specifically designed for assessing the quality of a motion; we refer to a distance function that is based on such a model as~\emph{motion quality distance}. The overall advantages of the proposed approach are 1) lower dimensional yet representative sequence representation and 2) a distance function that emphasizes time variation, the motion quality distance, which is a particularly important property for quality assessment. We validate our approach using a publicly available dataset, SPHERE-StairCase2014 dataset. Qualitative and quantitative results show promising performance.

Disciplines :

Computer science

Author, co-author :

Baptista, Renato ; University of Luxembourg > Interdisciplinary Centre for Security, Reliability and Trust (SNT)

Demisse, Girum ; University of Luxembourg > Interdisciplinary Centre for Security, Reliability and Trust (SNT)

Aouada, Djamila ; University of Luxembourg > Interdisciplinary Centre for Security, Reliability and Trust (SNT)

Ottersten, Björn ; University of Luxembourg > Interdisciplinary Centre for Security, Reliability and Trust (SNT)

External co-authors :

Language :

English

Title :

Deformation-Based Abnormal Motion Detection using 3D Skeletons

Publication date :

November 2018

Event name :

IEEE International Conference on Image Processing Theory, Tools and Applications (IPTA)

Event organizer :

Northwestern Polytechnical University

Event place :

Xi'An, China

Event date :

November 07-10, 2018

Audience :

International

Main work title :

IEEE International Conference on Image Processing Theory, Tools and Applications (IPTA)

Peer reviewed :

Peer reviewed

European Projects :

H2020 - 689947 - STARR - Decision SupporT and self-mAnagement system for stRoke survivoRs

Funders :

CE - Commission Européenne [BE]

Available on ORBilu :

since 05 November 2018

Statistics

Number of views

111 (5 by Unilu)

Number of downloads

233 (6 by Unilu)

More statistics

Scopus citations^®

Scopus citations^®
without self-citations

Bibliography

J.K. Aggarwal and M.S. Ryoo, "Human activity analysis: A review, " ACM Comput. Surv., vol. 43, no. 3, pp. 16:1-16:43, Apr. 2011.
O. P. Popoola and K. Wang, "Video-based abnormal human behavior recognition-A review, " IEEE Transactions on Systems, Man, Cybernetics, Part C (Applications and Reviews), vol. 42, no. 6, pp. 865-878, Nov 2012.
R. Baptista, M. Antunes, D. Aouada, B. Ottersten, "Anticipating suspicious actions using a small dataset of action templates, " in 13th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISAPP), 2018.
R. Poppe, "A survey on vision-based human action recognition, " Image and Vision Computing, vol. 28, no. 6, pp. 976-990, 2010.
K. Papadopoulos, M. Antunes, D. Aouada, B. Ottersten, "Enhanced trajectory-based action recognition using human pose, " in Image Processing (ICIP), 2017 IEEE International Conference on. IEEE, 2017, pp. 1807-1811.
K. Papadopoulos, M. Antunes, D. Aouada, B. Ottersten, "A revisit of action detection using improved trajectories, " in IEEE International Conference on Acoustics, Speech and Signal Processing, Calgary, Alberta, Canada, 15-20 April 2018, 2018.
H. Pirsiavash, C. Vondrick, A. Torralba, "Assessing the quality of actions, " in Computer Vision-ECCV 2014, pp. 556-571. Springer, 2014.
R. Wang, G. Medioni, C. Winstein, C. Blanco, "Home monitoring musculo-skeletal disorders with a single 3d sensor, " in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, 2013, pp. 521-528.
R. Baptista, E. Ghorbel, A. E. R. Shabayek, D. Aouada, B. Ottersten, "Key-skeleton based feedback tool for assisting physical activity, " in 2018 Zooming Innovation in Consumer Technologies Conference (ZINC). IEEE, 2018, pp. 175-176.
G. Kwakkel, B. J. Kollen, H. I. Krebs, "Effects of robot-assisted therapy on upper limb recovery after stroke: A systematic review, " Neurorehabilitation and neural repair, 2007.
P. Langhorne, G. Taylor, G. Murray, M. Dennis, C. Anderson, E. Bautz-Holter, P. Dey, B. Indredavik, N. Mayo, M. Power, et al., "Early supported discharge services for stroke patients: A meta-analysis of individual patients' data, " The Lancet, 2005.
V. Chandola, A. Banerjee, V. Kumar, "Anomaly detection: A survey, " ACM Comput. Surv., vol. 41, no. 3, pp. 15:1-15:58, July 2009.
A. Paiement, L. Tao, M. Camplani, S. Hannuna, D. Damen, M. Mirmehdi, "Online quality assessment of human motion from skeleton data, " in Proceedings of the British Machine Vision Conference. 2014, BMVA Press.
L. Tao, A. Paiement, D. Damen, M. Mirmehdi, S. Hannuna, M. Camplani, T. Burghardt, I. Craddock, "A comparative study of pose representation and dynamics modelling for online motion quality assessment, " Computer Vision and Image Understanding, 2016.
G. S. Parra-Dominguez, B. Taati, A. Mihailidis, "3d human motion analysis to detect abnormal events on stairs, " in 2012 Second International Conference on 3D Imaging, Modeling, Processing, Visualization Transmission, Oct 2012, pp. 97-103.
F. Nater, H. Grabner, L. Van Gool, "Exploiting simple hierarchies for unsupervised human behavior analysis, " in 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, June 2010, pp. 2014-2021.
J. Snoek, J. Hoey, L. Stewart, R. S. Zemel, A. Mihailidis, "Automated detection of unusual events on stairs, " Image and Vision Computing, vol. 27, no. 1-2, pp. 153-166, 2009.
G. G. Demisse, D. Aouada, B. Ottersten, "Similarity metric for curved shapes in euclidean space, " in The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 2016.
G. G. Demisse, D. Aouada, B. Ottersten, "Deformation based curved shape representation, " IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 40, no. 6, pp. 1338-1351, June 2018.
B. Schölkopf and A. J. Smola, "A short introduction to learning with kernels, " in Advanced lectures on machine learning, pp. 41-64. Springer, 2003.
J. Wang, Z. Liu, Y. Wu, J. Yuan, "Mining actionlet ensemble for action recognition with depth cameras, " in 2012 IEEE Conference on Computer Vision and Pattern Recognition, June 2012, pp. 1290-1297.
M. Antunes, D. Aouada, B. Ottersten, "A revisit to human action recognition from depth sequences: Guided svm-sampling for joint selection, " in 2016 IEEE Winter Conference on Applications of Computer Vision (WACV), March 2016, pp. 1-8.
C. M. Bishop, Pattern Recognition and Machine Learning (Information Science and Statistics), Springer-Verlag, Berlin, Heidelberg, 2006.
Meinard Müller, "Dynamic time warping, " Information retrieval for music and motion, pp. 69-84, 2007.
R. Vemulapalli, F. Arrate, R. Chellappa, "Human action recognition by representing 3d skeletons as points in a lie group, " in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2014.
M. Antunes, R. Baptista, G. Demisse, D. Aouada, B. Ottersten, "Visual and human-interpretable feedback for assisting physical activity, " in European Conference on Computer Vision (ECCV) Workshop on Assistive Computer Vision and Robotics Amsterdam, 2016.
R. Baptista, M. Antunes, A. E. R. Shabayek, D. Aouada, B. Ottersten, "Flexible feedback system for posture monitoring and correction, " in IEEE International Conference on Image Information Processing (ICIIP), 2017.
L. Miranda, T. Vieira, D. Martnez, T. Lewiner, A. W. Vieira, M. F. M. Campos, "Online gesture recognition from pose kernel learning and decision forests, " Pattern Recognition Letters, vol. 39, pp. 65-73, 2014.
F. Ofli, R. Chaudhry, G. Kurillo, R. Vidal, R. Bajcsy, "Sequence of the most informative joints (smij): A new representation for human skeletal action recognition, " in 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, June 2012, pp. 8-13.
G. G. Demisse, K. Papadopoulos, D. Aouada, B. Ottersten, "Pose encoding for robust skeleton-based action recognition, " CVPRW: Visual Understanding of Humans in Crowd Scene, Salt Lake City, Utah, June 18-22, 2018, 2018.