Shape-appearance-correlated active appearance model

Huiling Zhou, Kin Man Lam, Xiangjian He

Research output: Journal PublicationArticlepeer-review

16 Citations (Scopus)


Among the challenges faced by current active shape or appearance models, facial-feature localization in the wild, with occlusion in a novel face image, i.e. in a generic environment, is regarded as one of the most difficult computer-vision tasks. In this paper, we propose an Active Appearance Model (AAM) to tackle the problem of generic environment. Firstly, a fast face-model initialization scheme is proposed, based on the idea that the local appearance of feature points can be accurately approximated with locality constraints. Nearest neighbors, which have similar poses and textures to a test face, are retrieved from a training set for constructing the initial face model. To further improve the fitting of the initial model to the test face, an orthogonal CCA (oCCA) is employed to increase the correlation between shape features and appearance features represented by Principal Component Analysis (PCA). With these two contributions, we propose a novel AAM, namely the shape-appearance-correlated AAM (SAC-AAM), and the optimization is solved by using the recently proposed fast simultaneous inverse compositional (Fast-SIC) algorithm. Experiment results demonstrate a 5–10% improvement on controlled and semi-controlled datasets, and with around 10% improvement on wild face datasets in terms of fitting accuracy compared to other state-of-the-art AAM models.

Original languageEnglish
Pages (from-to)88-99
Number of pages12
JournalPattern Recognition
Publication statusPublished - 1 Aug 2016
Externally publishedYes


  • Canonical correlation analysis
  • Facial-feature localization
  • Generic active appearance model
  • Orthogonal CCA

ASJC Scopus subject areas

  • Software
  • Signal Processing
  • Computer Vision and Pattern Recognition
  • Artificial Intelligence


Dive into the research topics of 'Shape-appearance-correlated active appearance model'. Together they form a unique fingerprint.

Cite this