RoadBEV: Road Surface Reconstruction in Bird's Eye View

Tong Zhao, Lei Yang, Yichen Xie, Mingyu Ding, Masayoshi Tomizuka +1 more
4/9/2024
cs.CV

Official code: ztsrxh/RoadBEV (224 stars, MIT, last commit 2024-11-27).

Abstract

Road surface conditions, especially geometry profiles, enormously affect driving performance of autonomous vehicles. Vision-based online road reconstruction promisingly captures road information in advance. Existing solutions like monocular depth estimation and stereo matching suffer from modest performance. The recent technique of Bird's-Eye-View (BEV) perception provides immense potential to more reliable and accurate reconstruction. This paper uniformly proposes two simple yet effective models for road elevation reconstruction in BEV named RoadBEV-mono and RoadBEV-stereo, which estimate road elevation with monocular and stereo images, respectively. The former directly fits elevation values based on voxel features queried from image view, while the latter efficiently recognizes road elevation patterns based on BEV volume representing correlation between left and right voxel features. Insightful analyses reveal their consistence and difference with the perspective view. Experiments on real-world dataset verify the models' effectiveness and superiority. Elevation errors of RoadBEV-mono and RoadBEV-stereo achieve 1.83 cm and 0.50 cm, respectively. Our models are promising for practical road preview, providing essential information for promoting safety and comfort of autonomous vehicles. The code is released at https://github.com/ztsrxh/RoadBEV

View on arXivView PDF

Code Implementations(1)

ztsrxh/RoadBEVOfficial100%
MIT

Codes for RoadBEV: road surface reconstruction in Bird's Eye View

22425PythonApr 6, 20241 years agoMIT

Similar Papers

Cite this paper

@article{zhao2024roadbev,
  title  = {RoadBEV: Road Surface Reconstruction in Bird's Eye View},
  author = {Tong Zhao and Lei Yang and Yichen Xie and Mingyu Ding and Masayoshi Tomizuka and Yintao Wei},
  year   = {2024},
  eprint = {2404.06605},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2404.06605v3}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2404.06605.svg)](https://codeofpaper.com/paper/2404.06605)

Discussion