Vision-Language Navigation with Embodied Intelligence: A Survey

Peng Gao, Peng Wang, Feng Gao, Fei Wang, Ruyue Yuan
2/22/2024
cs.ROcs.AIcs.CV

No confident code implementation found for this paper. 2 possible matches can be shown below.

Abstract

As a long-term vision in the field of artificial intelligence, the core goal of embodied intelligence is to improve the perception, understanding, and interaction capabilities of agents and the environment. Vision-language navigation (VLN), as a critical research path to achieve embodied intelligence, focuses on exploring how agents use natural language to communicate effectively with humans, receive and understand instructions, and ultimately rely on visual information to achieve accurate navigation. VLN integrates artificial intelligence, natural language processing, computer vision, and robotics. This field faces technical challenges but shows potential for application such as human-computer interaction. However, due to the complex process involved from language understanding to action execution, VLN faces the problem of aligning visual information and language instructions, improving generalization ability, and many other challenges. This survey systematically reviews the research progress of VLN and details the research direction of VLN with embodied intelligence. After a detailed summary of its system architecture and research based on methods and commonly used benchmark datasets, we comprehensively analyze the problems and challenges faced by current research and explore the future development direction of this field, aiming to provide a practical reference for researchers.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. 2 weaker matches are hidden by default — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

Cite this paper

@article{gao2024visionlanguage,
  title  = {Vision-Language Navigation with Embodied Intelligence: A Survey},
  author = {Peng Gao and Peng Wang and Feng Gao and Fei Wang and Ruyue Yuan},
  year   = {2024},
  eprint = {2402.14304},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2402.14304v2}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2402.14304.svg)](https://codeofpaper.com/paper/2402.14304)

Discussion