NIR-VIS heterogeneous face recognition via cross-spectral joint dictionary learning and reconstruction

@article{JuefeiXu2015NIRVISHF,
  title={NIR-VIS heterogeneous face recognition via cross-spectral joint dictionary learning and reconstruction},
  author={Felix Juefei-Xu and Dipan K. Pal and Marios Savvides},
  journal={2015 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW)},
  year={2015},
  pages={141-150}
}
A lot of real-world data is spread across multiple domains. Handling such data has been a challenging task. Heterogeneous face biometrics has begun to receive attention in recent years. In real-world scenarios, many surveillance cameras capture data in the NIR (near infrared) spectrum. However, most datasets accessible to law enforcement have been collected in the VIS (visible light) domain. Thus, there exists a need to match NIR to VIS face images. In this paper, we approach the problem by… 
Not Afraid of the Dark: NIR-VIS Face Recognition via Cross-Spectral Hallucination and Low-Rank Embedding
TLDR
This paper proposes an approach to extend the deep learning breakthrough for VIS face recognition to the NIR spectrum, without retraining the underlying deep models that see only VIS faces, and obtains state-of-the-art accuracy on the CASIA NIR-VIS v2.0 benchmark.
Learning Invariant Deep Representation for NIR-VIS Face Recognition
TLDR
A deep convolutional network approach that uses only one network to map both NIR and VIS images to a compact Euclidean space and achieves 94% verification rate at FAR=0.1% on the challenging CASIA NIR-VIS 2.0 face recognition dataset.
Transferring deep representation for NIR-VIS heterogeneous face recognition
TLDR
A deep TransfeR NIR-VIS heterogeneous face recognition neTwork (TRIVET) with deep convolutional neural network with ordinal measures to learn discriminative models achieves state-of-the-art recognition performance on the most challenging CASIA Nir-VIS 2.0 Face Database.
Adversarial Cross-Spectral Face Completion for NIR-VIS Face Recognition
TLDR
This paper models high-resolution heterogeneous face synthesis as a complementary combination of two components: a texture inpainting component and a pose correction component and demonstrates that by attaching the correction component, it can simplify heterogenous face synthesis from one-to-many unpaired image translation to one- to-one paired image translation, and minimize the spectral and pose discrepancy during heterogeneous recognition.
Cross-spectral Face Completion for NIR-VIS Heterogeneous Face Recognition
TLDR
This paper models high resolution heterogeneous face synthesis as a complementary combination of two components, a texture inpainting component and pose correction component and demonstrates that by attaching the correction component, it can simplify heterogenous face synthesis from one-to-many unpaired image translation to one- to-one paired image translation, and minimize spectral and pose discrepancy during heterogeneous recognition.
Heterogeneous face recognition via grassmannian based nearest subspace search
TLDR
A subspace based method to tackle the problem of face recognition between visible images (VIS) and near infrared (NIR) images by adopting Grassmannian radial basis function (RBF) kernel and kernel canonical correlation analysis (KCCA) to handle correlation mapping between VIS and NIR domains.
Cross-Spectral Periocular Recognition by Cascaded Spectral Image Transformation
TLDR
This work proposes to adapt a cascaded image transformation network that can produce NIR image given a VIS image to demonstrate the biometric applicability and experimentally validate that the proposed image transformation scheme can production NIR like images and also can be used with any existing feature extraction scheme.
Wasserstein CNN: Learning Invariant Features for NIR-VIS Face Recognition
TLDR
This paper proposes the novel Wasserstein convolutional neural network approach for learning invariant features between near-infrared (NIR) and visual (VIS) face images and demonstrates the superiority of the WCNN method over state-of-the-art methods.
Face Recognition in the Dark: A Unified Approach for NIR- VIS and VIS- NIR Face Matching
Visible face recognition security systems fail to recognize the faces in total darkness. Near Infrared (NIR) spectrum provides an affordable and effectual method to capture good quality images in
LAMP-HQ: A Large-Scale Multi-pose High-Quality Database and Benchmark for NIR-VIS Face Recognition
TLDR
A novel exemplar-based variational spectral attention network to produce high-fidelity VIS images from NIR data and a spectral conditional attention module is introduced to reduce the domain gap between NIR and VIS data and improve the performance of NIR-VIS heterogeneous face recognition on various databases including the LAMP-HQ.
...
1
2
3
4
5
...

References

SHOWING 1-10 OF 37 REFERENCES
Coupled Spectral Regression for matching heterogeneous faces
  • Zhen Lei, S. Li
  • Computer Science
    2009 IEEE Conference on Computer Vision and Pattern Recognition
  • 2009
TLDR
This paper presents a subspace learning framework named Coupled Spectral Regression (CSR) to solve the challenge problem of coupling the two types of face images and matching between them, and shows that the proposed CSR method significantly outperforms the existing methods.
Transductive VIS-NIR face matching
TLDR
A transductive method named Transductive Heterogeneous Face Matching (THFM) is proposed by alleviating the domains difference and learning the discriminative model for target simultaneously, making it possible to take the query/probe NIR images into account in a transductives way.
Domain Adaptive Self-Taught Learning for Heterogeneous Face Recognition
TLDR
A novel Domain-independent Component Analysis (DiCA) algorithm for deriving a common subspace for relating and representing cross-domain image data and further advances the self-taught learning strategy for learning a domain-independent dictionary in the authors' DiCA subspace, which can be applied to both gallery and probe images of interest to improve representation and recognition.
Matching NIR Face to VIS Face Using Transduction
TLDR
This work proposes a transduction method named transductive heterogeneous face matching (THFM) to adapt the VIS-NIR matching learned from training with available image pairs to all people in the target set, and proposes a simple feature representation for effective VIS-nIR matching.
Hallucinating the Full Face from the Periocular Region via Dimensionally Weighted K-SVD
TLDR
This paper proposes an approach that will reconstruct the entire frontal face using just the periocular region, and empirically shows that the reconstruction technique, based on a modified sparsifying dictionary learning algorithm, can effectively reconstruct faces which are actually very similar to the original ground-truth faces.
The CASIA NIR-VIS 2.0 Face Database
TLDR
The composition of the database, evaluation protocols and baseline performance of PCA on the database are described and two interesting tricks, the facial symmetry and heterogeneous component analysis (HCA) are introduced to improve the performance.
Matching NIR face to VIS face using multi-feature based MSDA
  • Jie Li, Yi Jin, Q. Ruan
  • Mathematics
    2014 12th International Conference on Signal Processing (ICSP)
  • 2014
Visual and near infrared (VIS-NIR) face image matching, which is also called cross-spectral face matching in heterogeneous face recognition, is important for security application. However, most
Long Range Cross-Spectral Face Recognition: Matching SWIR Against Visible Light Images
TLDR
This work presents a novel cross-spectral face recognition scheme that encodes images filtered with a bank of Gabor filters followed by three local operators: Simplified Weber Local Descriptor, Local Binary Pattern, and Generalized Local Binary pattern.
Cross-spectral face recognition in heterogeneous environments: A case study on matching visible to short-wave infrared imagery
TLDR
The advantages and limitations of matching short wave infrared (SWIR) face images to visible images under controlled or uncontrolled conditions are investigated and the proposed cross-photometric score level fusion rule is illustrated to improve cross-spectral matching performance across all scenarios.
Heterogeneous face image matching using multi-scale features
TLDR
A common feature extraction method is designed to capture LSIFs based on a group of differential-based band-pass image filters, and it is shown that the scale for filters is critical.
...
1
2
3
4
...