Joint Bayesian guided metric learning for end-to-end face verification

Di Chen, Chunyan Xu, Jian Yang, Jianjun Qian, Yuhui Zheng, Linlin Shen

Research output: Journal PublicationArticlepeer-review

6 Citations (Scopus)

Abstract

In this work, we address the problem of face verification, namely determining whether a pair of face images belongs to the same or different subjects. Previous works often consider solving the problem of face verification in two steps: feature extraction and face recognition, resulting in a fragmented procedure. We argue that these techniques, although working well, fail to explicitly exploit a full end-to-end framework for face verification, which has received much attention and achieved significant improvements recently. In this paper, we propose a novel Joint Bayesian guided metric learning technique for dealing with the face verification task, which well integrates the above two steps of face verification into an end-to-end convolutional neural network (CNN) architecture. In the training stage, an initial neural network, which has the similar architecture with GoogLeNet CNN model, is firstly pre-trained by optimizing classification-based objective functions on the publicly available CASIA WebFace database. Based on constructed face pairs dataset from CASIA WebFace and LFW datasets, we then fine-tune the whole network parameters under the guide of the learned knowledge, which is obtained from the highly successful Joint Bayesian model. This guided learning procedure, which can also be seen as a metric learning technique, can further update network parameters for discriminating face pairs. In the testing process, the outputs by this unified network are discriminated with a threshold value to produce the ultimate prediction for the face verification task. Comprehensive evaluations over the LFW dataset well demonstrate the encouraging face verification performance of our proposed framework.

Original languageEnglish
Pages (from-to)560-567
Number of pages8
JournalNeurocomputing
Volume275
DOIs
Publication statusPublished - 31 Jan 2018
Externally publishedYes

Keywords

  • Convolutional neural network
  • Face verification
  • Joint Bayesian model

ASJC Scopus subject areas

  • Computer Science Applications
  • Cognitive Neuroscience
  • Artificial Intelligence

Fingerprint

Dive into the research topics of 'Joint Bayesian guided metric learning for end-to-end face verification'. Together they form a unique fingerprint.

Cite this