CAMHID: Camera motion histogram descriptor and its application to cinematographic shot classification

Muhammad Abul Hasan, Min Xu, Xiangjian He, Changsheng Xu

Research output: Journal PublicationArticlepeer-review

24 Citations (Scopus)

Abstract

In this paper, we propose a nonparametric camera motion descriptor for video shot classification. In the proposed method, a motion vector field (MVF) is constructed for each consecutive video frame by computing the motion vector (MV) of each macroblock. Then, the MVFs are divided into a number of local region of equal size. Next, the inconsistent/noisy MVs of each local region are eliminated by a motion consistency analysis. The remaining MVs of each local region from a number of consecutive frames are further collected for a compact representation. Initially, a matrix is formed using the MVs. Then, the matrix is decomposed using a singular value decomposition technique to represent the dominant motion. Finally, the angle of the most variance retaining principal component is computed and quantized to represent the motion of a local region by using a histogram. In order to represent the global camera motion, the local histograms are combined. The effectiveness of the proposed motion descriptor for video shot classification is tested by using a support vector machine. First, the proposed camera motion descriptors for video shots classification are computed on a video data set consisting of regular camera motion patterns (e.g., pan, zoom, tilt, static). Then, we apply the camera motion descriptors with an extended set of features to the classification of cinematographic shots. The experimental results show that the proposed shot level camera motion descriptor has a strong discriminative capability to classify different camera motion patterns of different videos effectively. We also show that our approach outperforms state-of-the-art methods.

Original languageEnglish
Article number6872825
Pages (from-to)1682-1695
Number of pages14
JournalIEEE Transactions on Circuits and Systems for Video Technology
Volume24
Issue number10
DOIs
Publication statusPublished - 1 Oct 2014
Externally publishedYes

Keywords

  • Motion analysis
  • singular value decomposition (SVD)
  • video shot classification

ASJC Scopus subject areas

  • Media Technology
  • Electrical and Electronic Engineering

Fingerprint

Dive into the research topics of 'CAMHID: Camera motion histogram descriptor and its application to cinematographic shot classification'. Together they form a unique fingerprint.

Cite this