Evaluating and Benchmarking Foundation Models for Earth Observation and Geospatial AI

Nikolaos Dionelis, Casper Fibaek, Luke Camilleri, Andreas Luyts, Jente Bosmans +1 more
6/26/2024
cs.CVcs.LG

No confident code implementation found for this paper. 2 possible matches can be shown below.

Abstract

When we are primarily interested in solving several problems jointly with a given prescribed high performance accuracy for each target application, then Foundation Models should for most cases be used rather than problem-specific models. We focus on the specific Computer Vision application of Foundation Models for Earth Observation (EO) and geospatial AI. These models can solve important problems we are tackling, including for example land cover classification, crop type mapping, flood segmentation, building density estimation, and road regression segmentation. In this paper, we show that for a limited number of labelled data, Foundation Models achieve improved performance compared to problem-specific models. In this work, we also present our proposed evaluation benchmark for Foundation Models for EO. Benchmarking the generalization performance of Foundation Models is important as it has become difficult to standardize a fair comparison across the many different models that have been proposed recently. We present the results using our evaluation benchmark for EO Foundation Models and show that Foundation Models are label efficient in the downstream tasks and help us solve problems we are tackling in EO and remote sensing.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. 2 weaker matches are hidden by default — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

Cite this paper

@article{dionelis2024evaluating,
  title  = {Evaluating and Benchmarking Foundation Models for Earth Observation and Geospatial AI},
  author = {Nikolaos Dionelis and Casper Fibaek and Luke Camilleri and Andreas Luyts and Jente Bosmans and Bertrand Le Saux},
  year   = {2024},
  eprint = {2406.18295},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2406.18295v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2406.18295.svg)](https://codeofpaper.com/paper/2406.18295)

Discussion