The Wallpaper is Ugly: Indoor Localization using Vision and Language

Seth Pate, Lawson L. S. Wong
10/4/2024
cs.CV

No confident code implementation found for this paper. 1 possible match can be shown below.

Abstract

We study the task of locating a user in a mapped indoor environment using natural language queries and images from the environment. Building on recent pretrained vision-language models, we learn a similarity score between text descriptions and images of locations in the environment. This score allows us to identify locations that best match the language query, estimating the user's location. Our approach is capable of localizing on environments, text, and images that were not seen during training. One model, finetuned CLIP, outperformed humans in our evaluation.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. 1 weaker match is hidden by default — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

LangLoc: "Tell Me What You See"

86% match2026

Pixel Aligned Language Models

84% match2023

Exploring Emerging Trends and Research Opportunities in Visual Place Recognition

84% match2024

Fine-Tuning Vision-Language Models for Visual Navigation Assistance

83% match2025

IndoorGNN: A Graph Neural Network based approach for Indoor Localization using WiFi RSSI

83% match2023

Griffon: Spelling out All Object Locations at Any Granularity with Large Language Models

83% match1 repo2492023

Cite this paper

@article{pate2024wallpaper,
  title  = {The Wallpaper is Ugly: Indoor Localization using Vision and Language},
  author = {Seth Pate and Lawson L. S. Wong},
  year   = {2024},
  eprint = {2410.03900},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2410.03900v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2410.03900.svg)](https://codeofpaper.com/paper/2410.03900)

Discussion