DeePoint: Visual Pointing Recognition and Direction Estimation

Shu Nakamura, Yasutomo Kawanishi, S. Nobuhara, K. Nishino
4/1/2023

No confident code implementation found for this paper. 1 possible match can be shown below.

Abstract

In this paper, we realize automatic visual recognition and direction estimation of pointing. We introduce the first neural pointing understanding method based on two key contributions. The first is the introduction of a first-of-its-kind large-scale dataset for pointing recognition and direction estimation, which we refer to as the DP Dataset. DP Dataset consists of more than 2 million frames of 33 people pointing in various styles annotated for each frame with pointing timings and 3D directions. The second is DeePoint, a novel deep network model for joint recognition and 3D direction estimation of pointing. DeePoint is a Transformer-based network which fully leverages the spatio-temporal coordination of the body parts, not just the hands. Through extensive experiments, we demonstrate the accuracy and efficiency of DeePoint. We believe DP Dataset and DeePoint will serve as a sound foundation for visual human intention understanding.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. 1 weaker match is hidden by default — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

AD-DINO: Attention-Dynamic DINO for Distance-Aware Embodied Reference Understanding

83% match2024

Do MLLMs Understand Pointing? Benchmarking and Enhancing Referential Reasoning in Egocentric Vision

83% match1 repo212026

Pointing-Guided Target Estimation via Transformer-Based Attention

80% match1 repo12025

Poivre: Self-Refining Visual Pointing with Reinforcement Learning

79% match2025

A Methodological and Structural Review of Hand Gesture Recognition Across Diverse Data Modalities

79% match2024

Quater-GCN: Enhancing 3D Human Pose Estimation with Orientation and Semi-supervised Training

79% match2024

Cite this paper

@article{nakamura2023deepoint,
  title  = {DeePoint: Visual Pointing Recognition and Direction Estimation},
  author = {Shu Nakamura and Yasutomo Kawanishi and S. Nobuhara and K. Nishino},
  year   = {2023},
  eprint = {2304.06977},
  archivePrefix = {arXiv},
  url    = {https://arxiv.org/abs/2304.06977},
  journal = {ICCV 2023 2023}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2304.06977.svg)](https://codeofpaper.com/paper/2304.06977)

Discussion