Scalable High-Dimensional Multivariate Linear Regression for Feature-Distributed Data

Shuo-Chieh Huang, Ruey S. Tsay
7/7/2023
stat.MLcs.DCcs.LG

No confident code implementation found for this paper. 2 possible matches can be shown below.

Abstract

Feature-distributed data, referred to data partitioned by features and stored across multiple computing nodes, are increasingly common in applications with a large number of features. This paper proposes a two-stage relaxed greedy algorithm (TSRGA) for applying multivariate linear regression to such data. The main advantage of TSRGA is that its communication complexity does not depend on the feature dimension, making it highly scalable to very large data sets. In addition, for multivariate response variables, TSRGA can be used to yield low-rank coefficient estimates. The fast convergence of TSRGA is validated by simulation experiments. Finally, we apply the proposed TSRGA in a financial application that leverages unstructured data from the 10-K reports, demonstrating its usefulness in applications with many dense large-dimensional matrices.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. 2 weaker matches are hidden by default — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

Communication-Efficient l_0 Penalized Least Square

81% match2025

High-Dimensional Distributed Sparse Classification with Scalable Communication-Efficient Global Updates

79% match1 repo2024

Feature Adaptation for Sparse Linear Regression

78% match2026

Distributed and Rate-Adaptive Feature Compression

76% match2024

AdaTrans: Feature-wise and Sample-wise Adaptive Transfer Learning for High-dimensional Regression

75% match2024

Nonlinear Feature Aggregation: Two Algorithms driven by Theory

75% match2023

Cite this paper

@article{huang2023scalable,
  title  = {Scalable High-Dimensional Multivariate Linear Regression for Feature-Distributed Data},
  author = {Shuo-Chieh Huang and Ruey S. Tsay},
  year   = {2023},
  eprint = {2307.03410},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2307.03410v2}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2307.03410.svg)](https://codeofpaper.com/paper/2307.03410)

Discussion