Families In Wild Multimedia (FIW-MM): A Multi-Modal Database for Recognizing Kinship

@article{Robinson2021FamiliesIW,
  title={Families In Wild Multimedia (FIW-MM): A Multi-Modal Database for Recognizing Kinship},
  author={Joseph P. Robinson and Zaid Khan and Yu Yin and Ming Shao and Yun Raymond Fu},
  journal={ArXiv},
  year={2021},
  volume={abs/2007.14509}
}
Kinship is a soft biometric that researchers found detectable in media, and although it is difficult, it comes with an abundance of practical applications. There is continual interest to solve the problem shown by the consistent performance improvements kinship recognition problems based on the large-scale still-image Families In the Wild (FIW) database-- systems are at levels unforeseeable a decade ago: approaching ever closer to being acceptable for real-world use. Biometric tasks have shown… 

Figures and Tables from this paper

The 5th Recognizing Families in the Wild Data Challenge: Predicting Kinship from Faces
TLDR
Submissions for this year's RFIW are summarized, and the results for kinship verification, tri-subject verification, and family member search and retrieval are reviewed.
One Label, One Billion Faces: Usage and Consistency of Racial Categories in Computer Vision
TLDR
An empirical study of computer vision datasets supplying categorical race labels for face images to determine the cross-dataset consistency and generalization of racial categories finds evidence that racial categories encode stereotypes, and exclude ethnic groups from categories on the basis of nonconformity to stereotypes.
Survey on the Analysis and Modeling of Visual Kinship: A Decade in the Making.
TLDR
The public resources and data challenges that enabled and inspired many to hone-in on the views of automatic kinship recognition in the visual domain are reviewed and a stronghold for the state of progress for the different problems is established.
A Unified Approach to Kinship Verification
  • Eran Dahan, Y. Keller
  • Computer Science
    IEEE Transactions on Pattern Analysis and Machine Intelligence
  • 2021
TLDR
This work proposes a deep learning-based approach for kin verification using a unified multi-task learning scheme where all kinship classes are jointly learned, and introduces a novel approach for fusing the embeddings of kin images to avoid overfitting.
Recognizing Families In the Wild (RFIW): The 4th Edition
  • Joseph P. Robinson, Yu Yin, Y. Fu
  • Computer Science
    2020 15th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2020)
  • 2020
TLDR
The purpose of this paper is to describe the 2020 RFIW challenge, end-to-end, along with forecasts in promising future directions.

References

SHOWING 1-10 OF 98 REFERENCES
IARPA Janus Benchmark - C: Face Dataset and Protocol
TLDR
The IARPA Janus Benchmark–C (IJB-C) face dataset advances the goal of robust unconstrained face recognition, improving upon the previous public domain IJB-B dataset, by increasing dataset size and variability, and by introducing end-to-end protocols that more closely model operational face recognition use cases.
VoxCeleb: A Large-Scale Speaker Identification Dataset
TLDR
This paper proposes a fully automated pipeline based on computer vision techniques to create a large scale text-independent speaker identification dataset collected 'in the wild', and shows that a CNN based architecture obtains the best performance for both identification and verification.
Recognizing families in the wild: The 4th edition
  • In Conference on Automatic Face and Gesture Recognition,
  • 2020
Visual Kinship Recognition of Families in the Wild
TLDR
It is shown that pre-trained CNN models fine-tuned on FIW outscores other conventional methods and achieved state-of-the art on the renowned KinWild datasets and is statistically compare FIW to related datasets, which unarguably shows enormous gains in overall size and amount of information encapsulated in the labels.
Families in the Wild (FIW): Large-Scale Kinship Image Database and Benchmarks
TLDR
This work presents the largest kinship recognition dataset to date, Families in the Wild, and demonstrates that a pre-trained Convolutional Neural Network as an off-the-shelf feature extractor outperforms the other feature types.
Balancing Biases and Preserving Privacy on Balanced Faces in the Wild
TLDR
This work mitigate the imbalanced performances using a novel domain adaptation learning scheme on the facial features extracted using state-of-the-art using a benefit of the proposed is to preserve identity information in facial features while removing demographic knowledge in the lower dimensional features.
One Label, One Billion Faces: Usage and Consistency of Racial Categories in Computer Vision
TLDR
An empirical study of computer vision datasets supplying categorical race labels for face images to determine the cross-dataset consistency and generalization of racial categories finds evidence that racial categories encode stereotypes, and exclude ethnic groups from categories on the basis of nonconformity to stereotypes.
Survey on the Analysis and Modeling of Visual Kinship: A Decade in the Making.
TLDR
The public resources and data challenges that enabled and inspired many to hone-in on the views of automatic kinship recognition in the visual domain are reviewed and a stronghold for the state of progress for the different problems is established.
Visual Kinship Recognition: A Decade in the Making
TLDR
The public resources and data challenges that enabled and inspired many to hone-in on one or more views of automatic kinship recognition in the visual domain are reviewed and a stronghold for the state of progress is established for the different problems in a consistent manner.
Investigating Bias in Deep Face Analysis: The KANFace Dataset and Empirical Study
...
...