Gaze-DETR: Using Expert Gaze to Reduce False Positives in Vulvovaginal Candidiasis Screening

Yan Kong, Sheng Wang, Jiangdong Cai, Zihao Zhao, Zhenrong Shen +3 more
5/15/2024
cs.CV

No official code found. Best implementation: YanKong0408/Gaze-DETR (5 stars, last commit 2024-05-17).

Abstract

Accurate detection of vulvovaginal candidiasis is critical for women's health, yet its sparse distribution and visually ambiguous characteristics pose significant challenges for accurate identification by pathologists and neural networks alike. Our eye-tracking data reveals that areas garnering sustained attention - yet not marked by experts after deliberation - are often aligned with false positives of neural networks. Leveraging this finding, we introduce Gaze-DETR, a pioneering method that integrates gaze data to enhance neural network precision by diminishing false positives. Gaze-DETR incorporates a universal gaze-guided warm-up protocol applicable across various detection methods and a gaze-guided rectification strategy specifically designed for DETR-based models. Our comprehensive tests confirm that Gaze-DETR surpasses existing leading methods, showcasing remarkable improvements in detection accuracy and generalizability.

View on arXivView PDF

Code Implementations(1)

YanKong0408/Gaze-DETRCommunity100%

for MICCAI 2024

50C++, CudaMar 13, 20242 years ago

Similar Papers

Deep Learning-based Eye-Tracking Analysis for Diagnosis of Alzheimer's Disease Using 3D Comprehensive Visual Stimuli

83% match2023

EG-SpikeFormer: Eye-Gaze Guided Transformer on Spiking Neural Networks for Medical Image Analysis

82% match2024

GazeGNN: A Gaze-Guided Graph Neural Network for Chest X-ray Classification

81% match1 repo222023

Gaze-directed Vision GNN for Mitigating Shortcut Learning in Medical Image

81% match1 repo2024

LEyes: A Lightweight Framework for Deep Learning-Based Eye Tracking using Synthetic Eye Images

80% match1 repo132023

GLANCE: Gaze-Led Attention Network for Compressed Edge-inference

80% match2026

Cite this paper

@article{kong2024gazedetr,
  title  = {Gaze-DETR: Using Expert Gaze to Reduce False Positives in Vulvovaginal Candidiasis Screening},
  author = {Yan Kong and Sheng Wang and Jiangdong Cai and Zihao Zhao and Zhenrong Shen and Yonghao Li and Manman Fei and Qian Wang},
  year   = {2024},
  eprint = {2405.09463},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2405.09463v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2405.09463.svg)](https://codeofpaper.com/paper/2405.09463)

Discussion