A Modular Robotic System for Autonomous Exploration and Semantic Updating in Large-Scale Indoor Environments

Sai Haneesh Allu, Itay Kadosh, Tyler Summers, Yu Xiang
9/23/2024
cs.ROcs.CV

No official code found. Best implementation: IRVLUTD/AutoX-SemMap (67 stars, MIT, last commit 2025-09-24).

Abstract

We present a modular robotic system for autonomous exploration and semantic updating of large-scale unknown environments. Our approach enables a mobile robot to build, revisit, and update a hybrid semantic map that integrates a 2D occupancy grid for geometry with a topological graph for object semantics. Unlike prior methods that rely on manual teleoperation or precollected datasets, our two-phase approach achieves end-to-end autonomy: first, a modified frontier-based exploration algorithm with dynamic search windows constructs a geometric map; second, using a greedy trajectory planner, environments are revisited, and object semantics are updated using open-vocabulary object detection and segmentation. This modular system, compatible with any metric SLAM framework, supports continuous operation by efficiently updating the semantic graph to reflect short-term and long-term changes such as object relocation, removal, or addition. We validate the approach on a Fetch robot in real-world indoor environments of approximately $8,500$m$^2$ and $117$m$^2$, demonstrating robust and scalable semantic mapping and continuous adaptation, marking a fully autonomous integration of exploration, mapping, and semantic updating on a physical robot.

View on arXivView PDF

Code Implementations(1)

MIT

Autonomous Exploration, Construction and Update of Semantic Map in real-time

6710C++, CMakeSep 22, 20241 years agoMIT
autonomous-navigationexplorationnavigationobject-detectionobject-segmentation+2 more

Similar Papers

Cite this paper

@article{allu2024modular,
  title  = {A Modular Robotic System for Autonomous Exploration and Semantic Updating in Large-Scale Indoor Environments},
  author = {Sai Haneesh Allu and Itay Kadosh and Tyler Summers and Yu Xiang},
  year   = {2024},
  eprint = {2409.15493},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2409.15493v3}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2409.15493.svg)](https://codeofpaper.com/paper/2409.15493)

Discussion