Abnormal behavior detection in surveillance video is a pivotal part of the intelligent city. Most of the existing methods only consider how to detect anomalies, with less considering to explain the reason of the anomalies. In this work, we investigate an orthogonal perspective based on the reason of these abnormal behaviors. We propose a multivariate fusion method that analyzes each target through three branches: object, action and motion. The object branch focuses on the appearance information, the motion branch focuses on the distribution of the motion features, and the action branch focuses on the action category of the target. The information that these branches focus on is different, and they can complement each other and jointly detect abnormal behavior. The final abnormal score can then be obtained by combining the abnormal scores of the three branches. In the action branch, we also propose an action recognition module using inter-frame information to solve the multi-target and multi-action recognition in the surveillance video, which is not utilized before in the anomaly detection field. The proposed method outperforms the state-of-the-art methods and also can explain why the target is detected as an anomaly.
Access to the requested content is limited to institutions that have purchased or subscribe to SPIE eBooks.
You are receiving this notice because your organization may not have SPIE eBooks access.*
*Shibboleth/Open Athens users─please
sign in
to access your institution's subscriptions.
To obtain this item, you may purchase the complete book in print or electronic format on
SPIE.org.
INSTITUTIONAL Select your institution to access the SPIE Digital Library.
PERSONAL Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.