Attention-Refined Unrolling for Sparse Sequential micro-Doppler Reconstruction

Riccardo Mazzieri, Jacopo Pegoraro, Michele Rossi
6/25/2023
eess.SPcs.LG

Official code: rmazzier/STAR (1 star, last commit 2024-07-08).

Abstract

The reconstruction of micro-Doppler signatures of human movements is a key enabler for fine-grained activity recognition wireless sensing. In Joint Communication and Sensing (JCS) systems, unlike in dedicated radar sensing systems, a suitable trade-off between sensing accuracy and communication overhead has to be attained. It follows that the micro-Doppler has to be reconstructed from incomplete windows of channel estimates obtained from communication packets. Existing approaches exploit compressed sensing, but produce very poor reconstructions when only a few channel measurements are available, which is often the case with real communication patterns. In addition, the large number of iterations they need to converge hinders their use in real-time systems. In this work, we propose and validate STAR, a neural network that reconstructs micro-Doppler sequences of human movement even from highly incomplete channel measurements. STAR is based upon a new architectural design that combines a single unrolled iterative hard-thresholding layer with an attention mechanism, used at its output. This results in an interpretable and lightweight architecture that reaps the benefits of both model-based and data driven solutions. STAR is evaluated on a public JCS dataset of 60 GHz channel measurements of human activity traces. Experimental results show that it substantially outperforms state-of-the-art techniques in terms of the reconstructed micro-Doppler quality. Remarkably, STAR enables human activity recognition with satisfactory accuracy even with 90% of missing channel measurements, for which existing techniques fail.

View on arXivView PDF

Code Implementations(1)

Implementation of the Single Thresholding with Attention Refinement (STAR) Model, a compact Neural Network for sparse micro-Doppler Reconstruction.

10PythonJun 21, 20232 years ago

Similar Papers

Cite this paper

@article{mazzieri2023attentionrefined,
  title  = {Attention-Refined Unrolling for Sparse Sequential micro-Doppler Reconstruction},
  author = {Riccardo Mazzieri and Jacopo Pegoraro and Michele Rossi},
  year   = {2023},
  eprint = {2306.14233},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2306.14233v2}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2306.14233.svg)](https://codeofpaper.com/paper/2306.14233)

Discussion