• Corpus ID: 235377159

# Multi-Facet Clustering Variational Autoencoders

@article{Falck2021MultiFacetCV,
title={Multi-Facet Clustering Variational Autoencoders},
author={Fabian Falck and Haoting Zhang and Matthew Willetts and George Nicholson and Christopher Yau and Christopher C. Holmes},
journal={ArXiv},
year={2021},
volume={abs/2106.05241}
}
• Published 9 June 2021
• Computer Science
• ArXiv
Work in deep clustering focuses on ﬁnding a single partition of data. However, high-dimensional data, such as images, typically feature multiple interesting characteristics one could cluster over. For example, images of objects against a background could be clustered over the shape of the object and separately by the colour of the background. In this paper, we introduce Multi-Facet Clustering Variational Autoencoders (MFCVAE) , a novel class of variational autoencoders with a hierarchy of…

### On Algorithmic Stability in Unsupervised Representation Learning

Surprisingly, it is found side information is not necessary for algorithmic stability: using standard quantitative measures of identiﬁability, deep generative models with latent clusterings are empirically identi ﬁable to the same degree as models which rely on auxiliary labels.

### I Don't Need u: Identifiable Non-Linear ICA Without Side Information

• Computer Science, Mathematics
ArXiv
• 2021
Surprisingly, it is found side information is not necessary for algorithmic stability: using standard quantitative measures of identiﬁability, deep generative models with latent clusterings are empirically identi ﬁable to the same degree as models which rely on auxiliary labels.

### Identifiability of deep generative models under mixture priors without auxiliary information

• Computer Science
ArXiv
• 2022
We prove identiﬁability of a broad class of deep latent variable models that (a) have universal approximation capabilities and (b) are the decoders of variational autoencoders that are commonly used

### A generative recommender system with GMM prior for cancer drug generation and sensitivity prediction

• Biology
ArXiv
• 2022
VADEERS offers a comprehensive model of drugs’ and cell lines’ properties and relationships between them, as well as a pre-computed clustering of the drugs by their inhibitory proﬁles.

### Identifying Parkinson’s disease subtypes with motor and non-motor symptoms via model-based multi-partition clustering

• Psychology, Medicine
Scientific reports
• 2021
A novel model-based multi-partition clustering method was applied on data from an international, multi-center, cross-sectional study of 402 Parkinson’s disease patients to identify new subtypes assuming that patients could be grouped differently according to certain sets of related symptoms.

### Multipartition clustering of mixed data with Bayesian networks

• Computer Science
Int. J. Intell. Syst.
• 2022
This paper proposes a multipartition clustering method that is able to efficiently deal with mixed data by exploiting the Bayesian network factorization and the variational Bayes framework and shows the flexibility and applicability of the proposed method by solving clustering, density estimation, and missing data imputation tasks in real‐world data sets.

## References

SHOWING 1-10 OF 78 REFERENCES

### Disentangling to Cluster: Gaussian Mixture Variational Ladder Autoencoders

• Computer Science
ArXiv
• 2019
This work proposes a clustering algorithm, VLAC, that outperforms a Gaussian Mixture DGM in cluster accuracy over digit identity on the test set of SVHN and demonstrates learning clusters jointly over numerous layers of the hierarchy of latent variables for the data.

### Towards K-means-friendly Spaces: Simultaneous Deep Learning and Clustering

• Computer Science
ICML
• 2017
A joint DR and K-means clustering approach in which DR is accomplished via learning a deep neural network (DNN) while exploiting theDeep neural network's ability to approximate any nonlinear function is proposed.

### Variational Deep Embedding: An Unsupervised and Generative Approach to Clustering

• Computer Science
IJCAI
• 2017
Variational Deep Embedding (VaDE) is proposed, a novel unsupervised generative clustering approach within the framework of Variational Auto-Encoder (VAE), which shows its capability of generating highly realistic samples for any specified cluster, without using supervised information during training.

### Deep Spectral Clustering Using Dual Autoencoder Network

• Computer Science
2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
• 2019
A joint learning framework for discriminative embedding and spectral clustering is proposed, which can significantly outperform state-of-the-art clustering approaches and be more robust to noise.

### beta-VAE: Learning Basic Visual Concepts with a Constrained Variational Framework

• Computer Science
ICLR
• 2017
Learning an interpretable factorised representation of the independent data generative factors of the world without supervision is an important precursor for the development of artificial

### Learning Latent Superstructures in Variational Autoencoders for Deep Multidimensional Clustering

• Computer Science
ICLR
• 2019
This work investigates a variant of variational autoencoders where there is a superstructure of discrete latent variables on top of the latent features, which is a tree structure of multiple super latent variables and it is automatically learned from data.

### ClusterGAN : Latent Space Clustering in Generative Adversarial Networks

• Computer Science
AAAI
• 2019
The results show a remarkable phenomenon that GANs can preserve latent space interpolation across categories, even though the discriminator is never exposed to such vectors.

### SpectralNet: Spectral Clustering using Deep Neural Networks

• Computer Science
ICLR
• 2018
A deep learning approach to spectral clustering that overcomes the major limitations of scalability and generalization of the spectral embedding and applies VC dimension theory to derive a lower bound on the size of SpectralNet.

### NVAE: A Deep Hierarchical Variational Autoencoder

• Computer Science
NeurIPS
• 2020
NVAE is the first successful VAE applied to natural images as large as 256$\times$256 pixels and achieves state-of-the-art results among non-autoregressive likelihood-based models on the MNIST, CIFAR-10, CelebA 64, and CelebA HQ datasets and it provides a strong baseline on FFHQ.

### Unsupervised Deep Embedding for Clustering Analysis

• Computer Science
ICML
• 2016
Deep Embedded Clustering is proposed, a method that simultaneously learns feature representations and cluster assignments using deep neural networks and learns a mapping from the data space to a lower-dimensional feature space in which it iteratively optimizes a clustering objective.