Stereo Anything: Unifying Zero-shot Stereo Matching with Large-Scale Mixed Data

Xianda Guo, Chenming Zhang, Youmin Zhang, Ruilin Wang, Dujun Nie +6 more
11/21/2024
cs.CV

Official code: XiandaGuo/OpenStereo (941 stars, last commit 2026-03-30).

Abstract

Stereo matching serves as a cornerstone in 3D vision, aiming to establish pixel-wise correspondences between stereo image pairs for depth recovery. Despite remarkable progress driven by deep neural architectures, current models often exhibit severe performance degradation when deployed in unseen domains, primarily due to the limited diversity of training data. In this work, we introduce StereoAnything, a data-centric framework that substantially enhances the zero-shot generalization capability of existing stereo models. Rather than devising yet another specialized architecture, we scale stereo training to an unprecedented level by systematically unifying heterogeneous stereo sources: (1) curated labeled datasets covering diverse environments, and (2) large-scale synthetic stereo pairs generated from unlabeled monocular images. Our mixed-data strategy delivers consistent and robust learning signals across domains, effectively mitigating dataset bias. Extensive zero-shot evaluations on four public benchmarks demonstrate that Stereo Anything achieves state-of-the-art generalization. This work paves the way towards truly universal stereo matching, offering a scalable data paradigm applicable to any stereo image pair. We extensively evaluate the zero-shot capabilities of our model on four public datasets, showcasing its impressive ability to generalize to any stereo image pair. Code is available at https://github.com/XiandaGuo/OpenStereo.

View on arXivView PDF

Code Implementations(1)

OpenStereo: A Comprehensive Benchmark for Stereo Matching

941117C, C++Mar 20, 20236 months ago

Similar Papers

Cite this paper

@article{guo2024stereo,
  title  = {Stereo Anything: Unifying Zero-shot Stereo Matching with Large-Scale Mixed Data},
  author = {Xianda Guo and Chenming Zhang and Youmin Zhang and Ruilin Wang and Dujun Nie and Wenzhao Zheng and Matteo Poggi and Hao Zhao and Mang Ye and Qin Zou and Long Chen},
  year   = {2024},
  eprint = {2411.14053},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2411.14053v3}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2411.14053.svg)](https://codeofpaper.com/paper/2411.14053)

Discussion