Facial expression synthesis with direction field preservation based mesh deformation and lighting fitting based wrinkle mapping

Weicheng Xie, Linlin Shen, Meng Yang, Jianmin Jiang

Research output: Journal PublicationArticlepeer-review

9 Citations (Scopus)

Abstract

Nowadays, facial expression synthesis is widely used in expression simulation, recognition and animation. While a variety of works available in literature are 3D based, these algorithms usually require face matching and trimming, are thus time consuming. In this work, an automatic algorithm for expression synthesis in 2D space is proposed, which mainly consists of three stages.The optimum matching of three sets of feature points on the faces of source neutral (Fsn), source expression (Fse) and target neutral (Ftn) are obtained in the first stage. Different components on the target face are deformed by learning from not only the displacements but also the geometry shape of face Fse in the second stage. In the last stage, the details of the source expression are mapped onto the corresponding positions on the target face by fitting of the lighting differences. Experimental results on expression synthesis with large geometry deformation and lighting difference show that the proposed algorithm is able to accurately preserve the geometry deformation, and the synthesized expressions are visually realistic.

Original languageEnglish
Pages (from-to)7565-7593
Number of pages29
JournalMultimedia Tools and Applications
Volume77
Issue number6
DOIs
Publication statusPublished - 1 Mar 2018
Externally publishedYes

Keywords

  • Expression synthesis
  • Face correspondence
  • Mesh deformation
  • Wrinkle fitting

ASJC Scopus subject areas

  • Software
  • Media Technology
  • Hardware and Architecture
  • Computer Networks and Communications

Fingerprint

Dive into the research topics of 'Facial expression synthesis with direction field preservation based mesh deformation and lighting fitting based wrinkle mapping'. Together they form a unique fingerprint.

Cite this