DIVA: A Dirichlet Process Mixtures Based Incremental Deep Clustering Algorithm via Variational Auto-Encoder

Zhenshan Bing, Yuan Meng, Yuqi Yun, Hang Su, Xiaojie Su +2 more
5/23/2023
cs.LGstat.ML

Official code: Ghiara/DIVA (13 stars, last commit 2023-09-18).

Abstract

Generative model-based deep clustering frameworks excel in classifying complex data, but are limited in handling dynamic and complex features because they require prior knowledge of the number of clusters. In this paper, we propose a nonparametric deep clustering framework that employs an infinite mixture of Gaussians as a prior. Our framework utilizes a memoized online variational inference method that enables the "birth" and "merge" moves of clusters, allowing our framework to cluster data in a "dynamic-adaptive" manner, without requiring prior knowledge of the number of features. We name the framework as DIVA, a Dirichlet Process-based Incremental deep clustering framework via Variational Auto-Encoder. Our framework, which outperforms state-of-the-art baselines, exhibits superior performance in classifying complex data with dynamically changing features, particularly in the case of incremental features. We released our source code implementation at: https://github.com/Ghiara/diva

View on arXivView PDF

Code Implementations(1)

Ghiara/DIVAOfficial100%

DIVA: A Dirichlet Process Mixtures Based Incremental Deep Clustering Algorithm via Variational Auto-Encoder

132Python, Jupyter NotebookApr 18, 20233 years ago
deep-clusteringdirichlet-process-mixturesgenerative-modelincremental-learningvariational-autoencoder

Similar Papers

Deep Generative Clustering with VAEs and Expectation-Maximization

83% match2025

DPGIIL: Dirichlet Process-Deep Generative Model-Integrated Incremental Learning for Clustering in Transmissibility-based Online Structural Anomaly Detection

82% match2024

TreeDiffusion: Hierarchical Generative Clustering for Conditional Diffusion

81% match1 repo102024

Deep Unsupervised Clustering with Gaussian Mixture Variational Autoencoders

81% match1 repo2162016

MNIST-Nd: a set of naturalistic datasets to benchmark clustering across dimensions

81% match2024

ClusterDDPM: An EM clustering framework with Denoising Diffusion Probabilistic Models

80% match1 repo2023

Cite this paper

@article{bing2023diva,
  title  = {DIVA: A Dirichlet Process Mixtures Based Incremental Deep Clustering Algorithm via Variational Auto-Encoder},
  author = {Zhenshan Bing and Yuan Meng and Yuqi Yun and Hang Su and Xiaojie Su and Kai Huang and Alois Knoll},
  year   = {2023},
  eprint = {2305.14067},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2305.14067v3}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2305.14067.svg)](https://codeofpaper.com/paper/2305.14067)

Discussion