Real-World Robot Applications of Foundation Models: A Review

Kento Kawaharazuka, Tatsuya Matsushima, Andrew Gambardella, Jiaxian Guo, Chris Paxton +1 more
2/8/2024
cs.ROcs.AIcs.CV

No confident code implementation found for this paper. 5 possible matches can be shown below.

Abstract

Recent developments in foundation models, like Large Language Models (LLMs) and Vision-Language Models (VLMs), trained on extensive data, facilitate flexible application across different tasks and modalities. Their impact spans various fields, including healthcare, education, and robotics. This paper provides an overview of the practical application of foundation models in real-world robotics, with a primary emphasis on the replacement of specific components within existing robot systems. The summary encompasses the perspective of input-output relationships in foundation models, as well as their role in perception, motion planning, and control within the field of robotics. This paper concludes with a discussion of future challenges and implications for practical robot applications.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. 5 weaker matches are hidden by default — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

Cite this paper

@article{kawaharazuka2024realworld,
  title  = {Real-World Robot Applications of Foundation Models: A Review},
  author = {Kento Kawaharazuka and Tatsuya Matsushima and Andrew Gambardella and Jiaxian Guo and Chris Paxton and Andy Zeng},
  year   = {2024},
  eprint = {2402.05741},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2402.05741v2}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2402.05741.svg)](https://codeofpaper.com/paper/2402.05741)

Discussion