Segment Anything Model (SAM) Meets Glass: Mirror and Transparent Objects Cannot Be Easily Detected

Dongsheng Han, Chaoning Zhang, Yu Qiao, Maryam Qamar, Yuna Jung +3 more
4/29/2023
cs.CVcs.AIcs.LG

No confident code implementation found for this paper.

Abstract

Meta AI Research has recently released SAM (Segment Anything Model) which is trained on a large segmentation dataset of over 1 billion masks. As a foundation model in the field of computer vision, SAM (Segment Anything Model) has gained attention for its impressive performance in generic object segmentation. Despite its strong capability in a wide range of zero-shot transfer tasks, it remains unknown whether SAM can detect things in challenging setups like transparent objects. In this work, we perform an empirical evaluation of two glass-related challenging scenarios: mirror and transparent objects. We found that SAM often fails to detect the glass in both scenarios, which raises concern for deploying the SAM in safety-critical situations that have various forms of glass.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. Any repos shown below are weak matches — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

Cite this paper

@article{han2023segment,
  title  = {Segment Anything Model (SAM) Meets Glass: Mirror and Transparent Objects Cannot Be Easily Detected},
  author = {Dongsheng Han and Chaoning Zhang and Yu Qiao and Maryam Qamar and Yuna Jung and SeungKyu Lee and Sung-Ho Bae and Choong Seon Hong},
  year   = {2023},
  eprint = {2305.00278},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2305.00278v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2305.00278.svg)](https://codeofpaper.com/paper/2305.00278)

Discussion