Violence detection based on spatio-temporal feature and fisher vector

Huangkai Cai, He Jiang, Xiaolin Huang, Jie Yang, Xiangjian He

Research output: Chapter in Book/Conference proceedingConference contributionpeer-review

4 Citations (Scopus)

Abstract

A novel framework based on local spatio-temporal features and a Bag-of-Words (BoW) model is proposed for violence detection. The framework utilizes Dense Trajectories (DT) and MPEG flow video descriptor (MF) as feature descriptors and employs Fisher Vector (FV) in feature coding. DT and MF algorithms are more descriptive and robust, because they are combinations of various feature descriptors, which describe trajectory shape, appearance, motion and motion boundary, respectively. FV is applied to transform low level features to high level features. FV method preserves much information, because not only the affiliations of descriptors are found in the codebook, but also the first and second order statistics are used to represent videos. Some tricks, that PCA, K-means++ and codebook size, are used to improve the final performance of video classification. In comprehensive consideration of accuracy, speed and application scenarios, the proposed method for violence detection is analysed. Experimental results show that the proposed approach outperforms the state-of-the-art approaches for violence detection in both crowd scenes and non-crowd scenes.

Original languageEnglish
Title of host publicationPattern Recognition and Computer Vision - First Chinese Conference, PRCV 2018, Proceedings
EditorsJian-Huang Lai, Hongbin Zha, Jie Zhou, Cheng-Lin Liu, Tieniu Tan, Nanning Zheng, Xilin Chen
PublisherSpringer Verlag
Pages180-190
Number of pages11
ISBN (Print)9783030033972
DOIs
Publication statusPublished - 2018
Externally publishedYes
Event1st Chinese Conference on Pattern Recognition and Computer Vision, PRCV 2018 - Guangzhou, China
Duration: 23 Nov 201826 Nov 2018

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume11256 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference1st Chinese Conference on Pattern Recognition and Computer Vision, PRCV 2018
Country/TerritoryChina
CityGuangzhou
Period23/11/1826/11/18

Keywords

  • Dense Trajectories
  • Fisher Vector
  • Linear support vector machine
  • MPEG flow video descriptor
  • Violence detection

ASJC Scopus subject areas

  • Theoretical Computer Science
  • General Computer Science

Fingerprint

Dive into the research topics of 'Violence detection based on spatio-temporal feature and fisher vector'. Together they form a unique fingerprint.

Cite this