PointFace: Point Set Based Feature Learning for 3D Face Recognition

Changyuan Jiang, Shisong Lin, Wei Chen, Feng Liu, Linlin Shen

Research output: Chapter in Book/Conference proceedingConference contributionpeer-review

Abstract

Though 2D face recognition (FR) has achieved great success due to powerful 2D CNNs and large-scale training data, it is still challenged by extreme poses and illumination conditions. On the other hand, 3D FR has the potential to deal with aforementioned challenges in the 2D domain. However, most of available 3D FR works transform 3D surfaces to 2D maps and utilize 2D CNNs to extract features. The works directly processing point clouds for 3D FR is very limited in literature. To bridge this gap, in this paper, we propose a light-weight framework, named PointFace, to directly process point set data for 3D FR. Inspired by contrastive learning, our PointFace use two weight-shared encoders to directly extract features from a pair of 3D faces. A feature similarity loss is designed to guide the encoders to obtain discriminative face representations. We also present a pair selection strategy to generate positive and negative pairs to boost training. Extensive experiments on Lock3DFace and Bosphorus show that the proposed PointFace outperforms state-of-The-Art 2D CNN based methods.

Original languageEnglish
Title of host publication2021 IEEE International Joint Conference on Biometrics, IJCB 2021
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781665437806
DOIs
Publication statusPublished - 4 Aug 2021
Externally publishedYes
Event2021 IEEE International Joint Conference on Biometrics, IJCB 2021 - Shenzhen, China
Duration: 4 Aug 20217 Aug 2021

Publication series

Name2021 IEEE International Joint Conference on Biometrics, IJCB 2021

Conference

Conference2021 IEEE International Joint Conference on Biometrics, IJCB 2021
Country/TerritoryChina
CityShenzhen
Period4/08/217/08/21

ASJC Scopus subject areas

  • Computer Vision and Pattern Recognition
  • Biomedical Engineering

Fingerprint

Dive into the research topics of 'PointFace: Point Set Based Feature Learning for 3D Face Recognition'. Together they form a unique fingerprint.

Cite this