Enhancing Object Detection Robustness: Detecting and Restoring Confidence in the Presence of Adversarial Patch Attacks

Roie Kazoom, Raz Birman, Ofer Hadar
3/4/2024
cs.CVcs.AI

No confident code implementation found for this paper.

Abstract

The widespread adoption of computer vision systems has underscored their susceptibility to adversarial attacks, particularly adversarial patch attacks on object detectors. This study evaluates defense mechanisms for the YOLOv5 model against such attacks. Optimized adversarial patches were generated and placed in sensitive image regions, by applying EigenCAM and grid search to determine optimal placement. We tested several defenses, including Segment and Complete (SAC), Inpainting, and Latent Diffusion Models. Our pipeline comprises three main stages: patch application, object detection, and defense analysis. Results indicate that adversarial patches reduce average detection confidence by 22.06\%. Defenses restored confidence levels by 3.45\% (SAC), 5.05\% (Inpainting), and significantly improved them by 26.61\%, which even exceeds the original accuracy levels, when using the Latent Diffusion Model, highlighting its superior effectiveness in mitigating the effects of adversarial patches.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. Any repos shown below are weak matches — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

IPG: Incremental Patch Generation for Generalized Adversarial Patch Training

93% match2025

I Don't Know You, But I Can Catch You: Real-Time Defense against Diverse Adversarial Patches for Object Detectors

90% match1 repo122024

A Survey of Adversarial Defenses in Vision-based Systems: Categorization, Methods and Challenges

89% match2025

ControlLoc: Physical-World Hijacking Attack on Visual Perception in Autonomous Driving

88% match2024

A Survey and Evaluation of Adversarial Attacks for Object Detection

88% match2024

Model Agnostic Defense against Adversarial Patch Attacks on Object Detection in Unmanned Aerial Vehicles

88% match2024

Cite this paper

@article{kazoom2024enhancing,
  title  = {Enhancing Object Detection Robustness: Detecting and Restoring Confidence in the Presence of Adversarial Patch Attacks},
  author = {Roie Kazoom and Raz Birman and Ofer Hadar},
  year   = {2024},
  eprint = {2403.12988},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2403.12988v2}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2403.12988.svg)](https://codeofpaper.com/paper/2403.12988)

Discussion