• Corpus ID: 204907140

Use of a Capsule Network to Detect Fake Images and Videos

@article{Nguyen2019UseOA,
  title={Use of a Capsule Network to Detect Fake Images and Videos},
  author={Huy Hoang Nguyen and Junichi Yamagishi and Isao Echizen},
  journal={ArXiv},
  year={2019},
  volume={abs/1910.12467}
}
The revolution in computer hardware, especially in graphics processing units and tensor processing units, has enabled significant advances in computer graphics and artificial intelligence algorithms. In addition to their many beneficial applications in daily life and business, computer-generated/manipulated images and videos can be used for malicious purposes that violate security systems, privacy, and social trust. The deepfake phenomenon and its variations enable a normal user to use his or… 

Figures and Tables from this paper

Deepfake Video Detection Using Convolutional Neural Network

  • A. Karandikar
  • Computer Science
    International Journal of Advanced Trends in Computer Science and Engineering
  • 2020
With the advent of new technological enhancements in artificial intelligence, new sophisticated AI techniques are used to create fake videos. Such videos can pose a great threat to the society in

Deepfake Forensics, an AI-synthesized Detection with Deep Convolutional Generative Adversarial Networks

  • Dafeng Gong
  • Computer Science
    International Journal of Advanced Trends in Computer Science and Engineering
  • 2020
TLDR
The findings indicate that although deepfakes pose a major threat to the authors' society, politics and commerce, a variety of means are listed to limit the production of unethical and illegaldeepfakes.

Face Manipulation Detection Based on Supervised Multi-Feature Fusion Attention Network

TLDR
A novel face manipulation detection method based on a supervised multi-feature fusion attention network (SMFAN) is proposed, and the SMFAN is added to the original capsule network to extract details of the fake face image.

iCaps-Dfake: An Integrated Capsule-Based Model for Deepfake Image and Video Detection

TLDR
A new deepfake detection approach, iCaps-Dfake, is proposed that competes with state-of-the-art techniques of deepfake video detection and addresses their low generalization problem.

Deep forgery discriminator via image degradation analysis

Generative adversarial network-based deep generative model is widely applied in creat-ing hyper-realistic face-swapping images and videos. However, its malicious use has posed a great threat to

Deepfake Video Detection with Facial Features and Long-Short Term Memory Deep Networks

TLDR
This paper explores whether the temporal information of the video can be used to increase the performance of state-of-the-art deepfake detection algorithms and shows that using the temporal dimension can greatly enhance theperformance of a deep learning model.

Deepfake detection through PRNU and logistic regression analyses

TLDR
This paper considers multiple approaches to distinguish between authentic and Deepfake videos, and discovers that none of the methods show definite proof of Deepfake presence or absence, and proposes a conceptual system to authenticate original media instead of discovering Deepfake forgeries.

Deepfake Detection Scheme Based on Vision Transformer and Distillation

TLDR
This paper designs that a CNN features and patchbased positioning model learns to interact with all positions to find the artifact region for solving false negative problem, and proves that the proposed scheme with patch embedding as input outperforms the state-of-the-art using the combined CNN features.

Face Forensics in the Wild

TLDR
This work constructs a novel large-scale dataset, called FFIW10K, which comprises 10,000 high-quality forgery videos, with an average of three human faces in each frame, and proposes a novel algorithm to tackle the task of multi-person face forgery detection.

Deepfakes: temporal sequential analysis to detect face-swapped video clips using convolutional long short-term memory

TLDR
An approach to detect deepfake videos of politicians using temporal sequential frames is proposed that uses the forged video to extract the frames at the first level followed by a deep depth-based convolutional long short-term memory model to identify the fake frames atThe second level.
...

References

SHOWING 1-10 OF 77 REFERENCES

Detection of GAN-Generated Fake Images over Social Networks

The diffusion of fake images and videos on social networks is a fast growing problem. Commercial media editing tools allow anyone to remove, add, or clone people and objects, to generate fake images.

Deep face liveness detection based on nonlinear diffusion using convolution neural network

TLDR
This paper presents an efficient and non-intrusive method to counter face-spoofing attacks that uses a single image to detect spoofing attacks and proposes a specialized deep convolution neural network that can extract the discriminative and high-level features of the input diffused image to differentiate between a fake face and a real face.

FaceForensics: A Large-scale Video Dataset for Forgery Detection in Human Faces

TLDR
A novel face manipulation dataset of about half a million edited images (from over 1000 videos) is introduced, which exceeds all existing video manipulation datasets by at least an order of magnitude and introduces benchmarks for classical image forensic tasks, including classification and segmentation.

Modular Convolutional Neural Network for Discriminating between Computer-Generated Images and Photographic Images

TLDR
A modular CGI--PI discriminator with a customized VGG-19 network as the feature extractor, statistical convolutional neural networks as thefeature transformers, and a discriminator is built that outperformed a state-of-the-art method and achieved accuracy up to 100%.

A Deep Learning Approach to Universal Image Manipulation Detection Using a New Convolutional Layer

TLDR
A universal forensic approach to performing manipulation detection using deep learning that can automatically learn how to detect multiple image manipulations without relying on pre-selected features or any preprocessing is proposed.

Face Liveness Detection From a Single Image via Diffusion Speed Model

TLDR
A real-time and nonintrusive method based on the diffusion speed of a single image to address spoofing using photographs or videos that accurately identifies diverse malicious attacks regardless of the medium of the image, e.g., paper or screen.

Do GANs Leave Artificial Fingerprints?

TLDR
It is shown that each GAN leaves its specific fingerprint in the images it generates, just like real-world cameras mark acquired images with traces of their photo-response non-uniformity pattern.

ForensicTransfer: Weakly-supervised Domain Adaptation for Forgery Detection

TLDR
A forensic embedding based on a novel autoencoder-based architecture that can be used to distinguish between real and fake imagery is learned, which acts as a form of anomaly detector and shows significant improvements in transferability.

Recurrent Convolutional Strategies for Face Manipulation Detection in Videos

TLDR
This work attempts to detect Deepfake, Face2Face and FaceSwap tampered faces in video streams using recurrent convolutional models and distill the best strategy for combining variations in these models along with domain specific face preprocessing techniques through extensive experimentation to obtain state-of-the-art performance on publicly available video-based facial manipulation benchmarks.

Distinguishing Between Natural and Computer-Generated Images Using Convolutional Neural Networks

TLDR
This paper designs and implements a new and appropriate network with two cascaded convolutional layers at the bottom of a CNN, which derives a forensic decision on local patches, and a global decision on a full-sized image can be easily obtained via simple majority voting.
...