Accelerating Cross-Validation in Multinomial Logistic Regression with $\ell_1$-Regularization

Tomoyuki Obuchi, Yoshiyuki Kabashima
11/15/2017
stat.MLcond-mat.dis-nn

No confident code implementation found for this paper.

Abstract

We develop an approximate formula for evaluating a cross-validation estimator of predictive likelihood for multinomial logistic regression regularized by an $\ell_1$-norm. This allows us to avoid repeated optimizations required for literally conducting cross-validation; hence, the computational time can be significantly reduced. The formula is derived through a perturbative approach employing the largeness of the data size and the model dimensionality. An extension to the elastic net regularization is also addressed. The usefulness of the approximate formula is demonstrated on simulated data and the ISOLET dataset from the UCI machine learning repository.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. Any repos shown below are weak matches — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

On Regularized Sparse Logistic Regression

81% match2023

Approximate Leave-One-Out for Fast Parameter Tuning in High Dimensions

81% match1 repo72018

Multinomial Logistic Regression: Asymptotic Normality on Null Covariates in High-Dimensions

78% match2023

Transfer Learning in $\ell_1$ Regularized Regression: Hyperparameter Selection Strategy based on Sharp Asymptotic Analysis

77% match2024

Improved Online Confidence Bounds for Multinomial Logistic Bandits

77% match1 repo2025

Bayesian Estimation of Mixed Multinomial Logit Models: Advances and Simulation-Based Evaluations

76% match1 repo72019

Cite this paper

@article{obuchi2017accelerating,
  title  = {Accelerating Cross-Validation in Multinomial Logistic Regression with $\ell_1$-Regularization},
  author = {Tomoyuki Obuchi and Yoshiyuki Kabashima},
  year   = {2017},
  eprint = {1711.05420},
  archivePrefix = {arXiv},
  url    = {https://arxiv.org/abs/1711.05420}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/1711.05420.svg)](https://codeofpaper.com/paper/1711.05420)

Discussion