Vision-and-Language Navigation Today and Tomorrow: A Survey in the Era of Foundation Models

Yue Zhang, Ziqiao Ma, Jialu Li, Yanyuan Qiao, Zun Wang +4 more
7/9/2024
cs.CLcs.CV

No official code found. Best implementation: zhangyuejoslin/VLN-Survey-with-Foundation-Models (301 stars, last commit 2026-04-17).

Abstract

Vision-and-Language Navigation (VLN) has gained increasing attention over recent years and many approaches have emerged to advance their development. The remarkable achievements of foundation models have shaped the challenges and proposed methods for VLN research. In this survey, we provide a top-down review that adopts a principled framework for embodied planning and reasoning, and emphasizes the current methods and future opportunities leveraging foundation models to address VLN challenges. We hope our in-depth discussions could provide valuable resources and insights: on one hand, to milestone the progress and explore opportunities and potential roles for foundation models in this field, and on the other, to organize different challenges and solutions in VLN to foundation model researchers.

View on arXivView PDF

Code Implementations(1)

zhangyuejoslin/VLN-Survey-with-Foundation-ModelsCommunity100%

[TMLR 2024] repository for VLN with foundation models

30114Sep 5, 20246 months ago

Similar Papers

A Navigation Framework Utilizing Vision-Language Models

86% match1 repo42025

Navigating the Nuances: A Fine-grained Evaluation of Vision-Language Navigation

85% match1 repo102024

MC-GPT: Empowering Vision-and-Language Navigation with Memory Map and Reasoning Chains

84% match2024

A Survey for Foundation Models in Autonomous Driving

83% match2024

End-to-End Navigation with Vision Language Models: Transforming Spatial Reasoning into Question-Answering

82% match1 repo1222024

Learning to Retrieve Navigable Candidates for Efficient Vision-and-Language Navigation

82% match2026

Cite this paper

@article{zhang2024visionandlanguage,
  title  = {Vision-and-Language Navigation Today and Tomorrow: A Survey in the Era of Foundation Models},
  author = {Yue Zhang and Ziqiao Ma and Jialu Li and Yanyuan Qiao and Zun Wang and Joyce Chai and Qi Wu and Mohit Bansal and Parisa Kordjamshidi},
  year   = {2024},
  eprint = {2407.07035},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2407.07035v2}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2407.07035.svg)](https://codeofpaper.com/paper/2407.07035)

Discussion