Using context saliency for movie shot classification

Min Xu, Jinqiao Wang, Muhammad A. Hasan, Xiangjian He, Changsheng Xu, Hanqing Lu, Jesse S. Jin

Research output: Chapter in Book/Conference proceedingConference contributionpeer-review

19 Citations (Scopus)

Abstract

Movie shot classification is vital but challenging task due to various movie genres, different movie shooting techniques and much more shot types than other video domain. Variety of shot types are used in movies in order to attract audiences attention and enhance their watching experience. In this paper, we introduce context saliency to measure visual attention distributed in keyframes for movie shot classification. Different from traditional saliency maps, context saliency map is generated by removing redundancy from contrast saliency and incorporating geometry constrains. Context saliency is later combined with color and texture features to generate feature vectors. Support Vector Machine (SVM) is used to classify keyframes into pre-defined shot classes. Different from the existing works of either performing in a certain movie genre or classifying movie shot into limited directing semantic classes, the proposed method has three unique features: 1) context saliency significantly improves movie shot classification; 2) our method works for all movie genres; 3) our method deals with the most common types of video shots in movies. The experimental results indicate that the proposed method is effective and efficient for movie shot classification.

Original languageEnglish
Title of host publicationICIP 2011
Subtitle of host publication2011 18th IEEE International Conference on Image Processing
Pages3653-3656
Number of pages4
DOIs
Publication statusPublished - 2011
Externally publishedYes
Event2011 18th IEEE International Conference on Image Processing, ICIP 2011 - Brussels, Belgium
Duration: 11 Sept 201114 Sept 2011

Publication series

NameProceedings - International Conference on Image Processing, ICIP
ISSN (Print)1522-4880

Conference

Conference2011 18th IEEE International Conference on Image Processing, ICIP 2011
Country/TerritoryBelgium
CityBrussels
Period11/09/1114/09/11

Keywords

  • Feature extraction
  • Image classification
  • Supervised learning
  • Support Vector Machines

ASJC Scopus subject areas

  • Software
  • Computer Vision and Pattern Recognition
  • Signal Processing

Fingerprint

Dive into the research topics of 'Using context saliency for movie shot classification'. Together they form a unique fingerprint.

Cite this