A Probabilistic Model for Data Redundancy in the Feature Domain

Ghurumuruhan Ganesan
9/24/2023
cs.LGmath.CO

No confident code implementation found for this paper.

Abstract

In this paper, we use a probabilistic model to estimate the number of uncorrelated features in a large dataset. Our model allows for both pairwise feature correlation (collinearity) and interdependency of multiple features (multicollinearity) and we use the probabilistic method to obtain upper and lower bounds of the same order, for the size of a feature set that exhibits low collinearity and low multicollinearity. We also prove an auxiliary result regarding mutually good constrained sets that is of independent interest.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. Any repos shown below are weak matches — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

Study Features via Exploring Distribution Structure

82% match2024

Student Copula Markov Networks

75% match2026

MVMR-FS : Non-parametric feature selection algorithm based on Maximum inter-class Variation and Minimum Redundancy

75% match2023

Dissimilar Batch Decompositions of Random Datasets

74% match2025

Landscape Complexity for the Empirical Risk of Generalized Linear Models: Discrimination between Structured Data

73% match2025

Simultaneous Inference for Multiple Proportions: A Multivariate Beta-Binomial Model

73% match1 repo32019

Cite this paper

@article{ganesan2023probabilistic,
  title  = {A Probabilistic Model for Data Redundancy in the Feature Domain},
  author = {Ghurumuruhan Ganesan},
  year   = {2023},
  eprint = {2309.13657},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2309.13657v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2309.13657.svg)](https://codeofpaper.com/paper/2309.13657)

Discussion