PointFaceFormer: Local and Global Attention Based Transformer for 3D Point Cloud Face Recognition

Ziqi Gao, Qiufu Li, Gui Wang, Linlin Shen

Research output: Chapter in Book/Conference proceedingConference contributionpeer-review

1 Citation (Scopus)

Abstract

Existing 3D point cloud-based facial recognition struggles to fully leverage both global and local information inherent in the 3D point cloud data. In this paper, we introduce the PointFaceFormer, the first Transformer model designed for 3D point cloud face recognition. It incorporates an attention mechanism based on dot product and cosine functions to construct a similarity Transformer architecture, which effectively extracts both local and global features from the point cloud data. Experimental results demonstrate that PointFaceFormer achieves a recognition accuracy of 89.08% and a verification accuracy of 76.93% on the large-scale facial point cloud dataset Lock3DFace, which is a new state-of-the-art in 3D face recognition. Furthermore, PointFaceFormer exhibits excellent generalization performance on cross-quality datasets. Additionally, we validate the effectiveness of the attention mechanism through ablation experiments, which justify the effectiveness of the proposed modules.

Original languageEnglish
Title of host publication2024 IEEE 18th International Conference on Automatic Face and Gesture Recognition, FG 2024
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9798350394948
DOIs
Publication statusPublished - 2024
Event18th IEEE International Conference on Automatic Face and Gesture Recognition, FG 2024 - Istanbul, Turkey
Duration: 27 May 202431 May 2024

Publication series

Name2024 IEEE 18th International Conference on Automatic Face and Gesture Recognition, FG 2024

Conference

Conference18th IEEE International Conference on Automatic Face and Gesture Recognition, FG 2024
Country/TerritoryTurkey
CityIstanbul
Period27/05/2431/05/24

ASJC Scopus subject areas

  • Computer Vision and Pattern Recognition
  • Signal Processing
  • Modelling and Simulation

Fingerprint

Dive into the research topics of 'PointFaceFormer: Local and Global Attention Based Transformer for 3D Point Cloud Face Recognition'. Together they form a unique fingerprint.

Cite this