Dynamic LIBRAS Gesture Recognition via CNN over Spatiotemporal Matrix Representation

Jasmine Moreira
3/26/2026
cs.CVcs.AI

No confident code implementation found for this paper.

Abstract

This paper proposes a method for dynamic hand gesture recognition based on the composition of two models: the MediaPipe Hand Landmarker, responsible for extracting 21 skeletal keypoints of the hand, and a convolutional neural network (CNN) trained to classify gestures from a spatiotemporal matrix representation of dimensions 90 by 21 of those keypoints. The method is applied to the recognition of LIBRAS (Brazilian Sign Language) gestures for device control in a home automation system, covering 11 classes of static and dynamic gestures. For real-time inference, a sliding window with temporal frame triplication is used, enabling continuous recognition without recurrent networks. Tests achieved 95\% accuracy under low-light conditions and 92\% under normal lighting. The results indicate that the approach is effective, although systematic experiments with greater user diversity are needed for a more thorough evaluation of generalization.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. Any repos shown below are weak matches — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

Real-Time Hand Gesture Recognition: Integrating Skeleton-Based Data Fusion and Multi-Stream CNN

89% match1 repo242024

Fast Real-Time Pipeline for Robust Arm Gesture Recognition

88% match2025

Resource-Efficient Gesture Recognition using Low-Resolution Thermal Camera via Spiking Neural Networks and Sparse Segmentation

86% match2024

Improving Intersession Reproducibility for Forearm Ultrasound based Hand Gesture Classification through an Incremental Learning Approach

86% match2024

Interpreting Hand gestures using Object Detection and Digits Classification

86% match2024

Research on gesture recognition method based on SEDCNN-SVM

85% match2024

Cite this paper

@article{moreira2026dynamic,
  title  = {Dynamic LIBRAS Gesture Recognition via CNN over Spatiotemporal Matrix Representation},
  author = {Jasmine Moreira},
  year   = {2026},
  eprint = {2603.25863},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2603.25863v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2603.25863.svg)](https://codeofpaper.com/paper/2603.25863)

Discussion