What Matters in Range View 3D Object Detection

Benjamin Wilson, Nicholas Autio Mitchell, Jhony Kaesemodel Pontes, James Hays
7/23/2024
cs.CVcs.AIcs.LG

Official code: benjaminrwilson/range-view-3d-detection (17 stars, MIT, last commit 2024-10-24).

Abstract

Lidar-based perception pipelines rely on 3D object detection models to interpret complex scenes. While multiple representations for lidar exist, the range-view is enticing since it losslessly encodes the entire lidar sensor output. In this work, we achieve state-of-the-art amongst range-view 3D object detection models without using multiple techniques proposed in past range-view literature. We explore range-view 3D object detection across two modern datasets with substantially different properties: Argoverse 2 and Waymo Open. Our investigation reveals key insights: (1) input feature dimensionality significantly influences the overall performance, (2) surprisingly, employing a classification loss grounded in 3D spatial proximity works as well or better compared to more elaborate IoU-based losses, and (3) addressing non-uniform lidar density via a straightforward range subsampling technique outperforms existing multi-resolution, range-conditioned networks. Our experiments reveal that techniques proposed in recent range-view literature are not needed to achieve state-of-the-art performance. Combining the above findings, we establish a new state-of-the-art model for range-view 3D object detection -- improving AP by 2.2% on the Waymo Open dataset while maintaining a runtime of 10 Hz. We establish the first range-view model on the Argoverse 2 dataset and outperform strong voxel-based baselines. All models are multi-class and open-source. Code is available at https://github.com/benjaminrwilson/range-view-3d-detection.

View on arXivView PDF

Code Implementations(1)

MIT
172Shell, PythonJul 23, 20241 years agoMIT
3d-object-detectionautonomous-drivingcorl-2024range-view

Similar Papers

Cite this paper

@article{wilson2024what,
  title  = {What Matters in Range View 3D Object Detection},
  author = {Benjamin Wilson and Nicholas Autio Mitchell and Jhony Kaesemodel Pontes and James Hays},
  year   = {2024},
  eprint = {2407.16789},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2407.16789v2}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2407.16789.svg)](https://codeofpaper.com/paper/2407.16789)

Discussion