ePrints

Pose-driven human activity anomaly detection in a CCTV-like environment

Lookup NU author(s): Dr Federico Angelini, Dr Mohsen Naqvi

Downloads

• Published version [.pdf]

Licence

This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License (CC BY-NC-ND).

Abstract

Human activity anomaly detection plays a crucial role in the next generation of surveillance and assisted living systems. Most anomaly detection algorithms are generative models and learn features from raw images. This work shows that popular state-of-the-art autoencoder-based anomaly detection systems are not capable of effectively detecting human posture and object-positions related anomalies. Therefore, a human pose-driven and object detector based deep learning architecture is proposed, which simultaneously leverages human poses and raw RGB data to perform human activity anomaly detection. We demonstrate that pose-driven learning overcomes the raw RGB based counterpart limitations in different human activities classification. Extensive validation is provided by using popular datasets. Then, we demonstrate that with the aid of object detection, the human activities classification can be effectively used in human activity anomaly detection. Moreover, novel challenging datasets, i.e. BMbD, M-BMbD and JBMOPbD, are proposed for single and multi-target human posture anomaly detection and joint human posture and object position anomaly detection evaluations.

Publication metadata

Author(s): Yang Y, Angelini F, Naqvi SM

Publication type: Article

Publication status: Published

Journal: IET Image Processing

Year: 2023

Volume: 17

Issue: 3

Pages: 674-686

Print publication date: 28/02/2023

Online publication date: 22/10/2022

Acceptance date: 07/10/2022

Date deposited: 12/10/2022

ISSN (print): 1751-9659

ISSN (electronic): 1751-9667

Publisher: The Institution of Engineering and Technology

URL: https://doi.org/10.1049/ipr2.12664

DOI: 10.1049/ipr2.12664

ePrints DOI: 10.57711/d611-fk15

Data Access Statement: The data that support the findings of this study are available from the corresponding author upon reasonable request.

Altmetrics

Share