Model order reduction of deep structured state-space models: A system-theoretic approach

Marco Forgione, Manas Mejari, Dario Piga
3/21/2024
cs.LGeess.SY

No official code found. Best implementation: forgi86/lru-reduction (14 stars, MIT, last commit 2024-11-22).

Abstract

With a specific emphasis on control design objectives, achieving accurate system modeling with limited complexity is crucial in parametric system identification. The recently introduced deep structured state-space models (SSM), which feature linear dynamical blocks as key constituent components, offer high predictive performance. However, the learned representations often suffer from excessively large model orders, which render them unsuitable for control design purposes. The current paper addresses this challenge by means of system-theoretic model order reduction techniques that target the linear dynamical blocks of SSMs. We introduce two regularization terms which can be incorporated into the training loss for improved model order reduction. In particular, we consider modal $\ell_1$ and Hankel nuclear norm regularization to promote sparsity, allowing one to retain only the relevant states without sacrificing accuracy. The presented regularizers lead to advantages in terms of parsimonious representations and faster inference resulting from the reduced order models. The effectiveness of the proposed methodology is demonstrated using real-world ground vibration data from an aircraft.

View on arXivView PDF

Code Implementations(1)

MIT

Python code of the paper Model order reduction of deep structured state-space models: A system-theoretic approach

141Shell, PythonMar 19, 20241 years agoMIT
linear-recurrent-unitsmachine-learningmodel-order-reductionstructured-state-space-modelssystem-identification

Similar Papers

Cite this paper

@article{forgione2024model,
  title  = {Model order reduction of deep structured state-space models: A system-theoretic approach},
  author = {Marco Forgione and Manas Mejari and Dario Piga},
  year   = {2024},
  eprint = {2403.14833},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2403.14833v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2403.14833.svg)](https://codeofpaper.com/paper/2403.14833)

Discussion