PhysDepth: Plug-and-Play Physical Refinement for Monocular Depth Estimation in Challenging Environments

Kebin Peng, Haotang Li, Zhenyu Qi, Huashan Chen, Zi Wang +4 more
12/5/2024
cs.CV

No confident code implementation found for this paper.

Abstract

State-of-the-art monocular depth estimation (MDE) models often struggle in challenging environments, primarily because they overlook robust physical information. To demonstrate this, we first conduct an empirical study by computing the covariance between a model's prediction error and atmospheric attenuation. We find that the error of existing SOTAs increases with atmospheric attenuation. Based on this finding, we propose PhysDepth, a plug-and-play framework that solves this fragility by infusing physical priors into modern SOTA backbones. PhysDepth incorporates two key components: a Physical Prior Module (PPM) that leverages Rayleigh Scattering theory to extract robust features from the high-SNR red channel, and a physics-derived Red Channel Attenuation Loss (RCA) that enforces model to learn the Beer-Lambert law. Extensive evaluations demonstrate that PhysDepth achieves SOTA accuracy in challenging conditions.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. Any repos shown below are weak matches — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

Cite this paper

@article{peng2024physdepth,
  title  = {PhysDepth: Plug-and-Play Physical Refinement for Monocular Depth Estimation in Challenging Environments},
  author = {Kebin Peng and Haotang Li and Zhenyu Qi and Huashan Chen and Zi Wang and Wei Zhang and Sen He and Huanrui Yang and Qing Guo},
  year   = {2024},
  eprint = {2412.04666},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2412.04666v3}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2412.04666.svg)](https://codeofpaper.com/paper/2412.04666)

Discussion