NeurCAM: Interpretable Neural Clustering via Additive Models

Nakul Upadhya, Eldan Cohen
8/23/2024
cs.LG

No official code found. Best implementation: optimal-uoft/NeurCAM (5 stars, MIT, last commit 2024-09-03).

Abstract

Interpretable clustering algorithms aim to group similar data points while explaining the obtained groups to support knowledge discovery and pattern recognition tasks. While most approaches to interpretable clustering construct clusters using decision trees, the interpretability of trees often deteriorates on complex problems where large trees are required. In this work, we introduce the Neural Clustering Additive Model (NeurCAM), a novel approach to the interpretable clustering problem that leverages neural generalized additive models to provide fuzzy cluster membership with additive explanations of the obtained clusters. To promote sparsity in our model's explanations, we introduce selection gates that explicitly limit the number of features and pairwise interactions leveraged. Additionally, we demonstrate the capacity of our model to perform text clustering that considers the contextual representation of the texts while providing explanations for the obtained clusters based on uni- or bi-word terms. Extensive experiments show that NeurCAM achieves performance comparable to black-box methods on tabular datasets while remaining interpretable. Additionally, our approach significantly outperforms other interpretable clustering approaches when clustering on text data.

View on arXivView PDF

Code Implementations(1)

MIT
51PythonAug 8, 20242 years agoMIT

Similar Papers

Cite this paper

@article{upadhya2024neurcam,
  title  = {NeurCAM: Interpretable Neural Clustering via Additive Models},
  author = {Nakul Upadhya and Eldan Cohen},
  year   = {2024},
  eprint = {2408.13361},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2408.13361v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2408.13361.svg)](https://codeofpaper.com/paper/2408.13361)

Discussion