Segment Anything Model for Road Network Graph Extraction

Congrui Hetang, Haoru Xue, Cindy Le, Tianwei Yue, Wenping Wang +1 more
3/24/2024
cs.CV

Official code: htcr/sam_road (286 stars, MIT, last commit 2024-08-10).

Abstract

We propose SAM-Road, an adaptation of the Segment Anything Model (SAM) for extracting large-scale, vectorized road network graphs from satellite imagery. To predict graph geometry, we formulate it as a dense semantic segmentation task, leveraging the inherent strengths of SAM. The image encoder of SAM is fine-tuned to produce probability masks for roads and intersections, from which the graph vertices are extracted via simple non-maximum suppression. To predict graph topology, we designed a lightweight transformer-based graph neural network, which leverages the SAM image embeddings to estimate the edge existence probabilities between vertices. Our approach directly predicts the graph vertices and edges for large regions without expensive and complex post-processing heuristics, and is capable of building complete road network graphs spanning multiple square kilometers in a matter of seconds. With its simple, straightforward, and minimalist design, SAM-Road achieves comparable accuracy with the state-of-the-art method RNGDet++, while being 40 times faster on the City-scale dataset. We thus demonstrate the power of a foundational vision model when applied to a graph learning task. The code is available at https://github.com/htcr/sam_road.

View on arXivView PDF

Code Implementations(1)

htcr/sam_roadOfficial100%
MIT

Segment Anything Model for large-scale, vectorized road network extraction from aerial imagery. CVPRW 2024

28639Go, ShellFeb 26, 20242 years agoMIT
autonomous-drivingcomputer-visioncvpr2024graphgraph-neural-networks+9 more

Similar Papers

Cite this paper

@article{hetang2024segment,
  title  = {Segment Anything Model for Road Network Graph Extraction},
  author = {Congrui Hetang and Haoru Xue and Cindy Le and Tianwei Yue and Wenping Wang and Yihui He},
  year   = {2024},
  eprint = {2403.16051},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2403.16051v3}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2403.16051.svg)](https://codeofpaper.com/paper/2403.16051)

Discussion