Multi-Scale ViT Inference with Habitat-Fit Priors and kNN Retrieval for Multi-Species Plant Identification

Alper Erten, Murilo Gustineli, Adrian Cheung
7/16/2026
cs.CVcs.AIcs.LG

Official code: dsgt-arc/plantclef-2026 (2 stars, MIT, last commit 2026-05-26).

Abstract

This paper describes DS@GT ARC's third-place solution to the PlantCLEF 2026 challenge on multi-species plant identification in vegetation quadrat images, where systems must predict every species present in high-resolution (~3000 x 3000 pixel) plot photographs while training only on single-label images of individual plants. The pipeline is built around a fine-tuned DINOv2 ViT-L/14 classifier applied over a multi-scale tile decomposition of each quadrat, with per-tile predictions blended with a FAISS kNN retriever and post-processed by source-aware temporal fusion across repeated plot visits, a habitat-fit demotion that injects geographic and altitude priors from the training data, and a South-Western Europe geographic mask. Habitat-fit demotion and multi-scale aggregation are the largest individual contributors in the ablations. Two complementary training-centric directions, a cross-region transformer with noisy-student distillation on the LUCAS dataset and a label-as-query transformer decoder over synthetic CLS-domain pseudo-quadrats, yielded null results. An inference-time augmentation with instance-aware segmentation crops also did not improve performance. The selected submission reaches a private-leaderboard macro-F1 of 0.43902 (third place; public 0.51096); an unselected configuration of the same pipeline scored above 0.45 on the private set. Code: https://github.com/dsgt-arc/plantclef-2026.

View on arXivView PDF

Code Implementations(1)

MIT

DS@GT ARC - PlantCLEF 2026 repo

20Shell, PythonFeb 8, 20264 months agoMIT

Similar Papers

Cite this paper

@article{erten2026multiscale,
  title  = {Multi-Scale ViT Inference with Habitat-Fit Priors and kNN Retrieval for Multi-Species Plant Identification},
  author = {Alper Erten and Murilo Gustineli and Adrian Cheung},
  year   = {2026},
  eprint = {2607.14509},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2607.14509v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2607.14509.svg)](https://codeofpaper.com/paper/2607.14509)

Discussion