Investigation of Architectures and Receptive Fields for Appearance-based Gaze Estimation

Yunhan Wang, Xiangwei Shi, Shalini De Mello, Hyung Jin Chang, Xucong Zhang
8/18/2023
cs.CV

No official code found. Best implementation: yunhanwang1105/GazeTech (12 stars, last commit 2024-03-12).

Abstract

With the rapid development of deep learning technology in the past decade, appearance-based gaze estimation has attracted great attention from both computer vision and human-computer interaction research communities. Fascinating methods were proposed with variant mechanisms including soft attention, hard attention, two-eye asymmetry, feature disentanglement, rotation consistency, and contrastive learning. Most of these methods take the single-face or multi-region as input, yet the basic architecture of gaze estimation has not been fully explored. In this paper, we reveal the fact that tuning a few simple parameters of a ResNet architecture can outperform most of the existing state-of-the-art methods for the gaze estimation task on three popular datasets. With our extensive experiments, we conclude that the stride number, input image resolution, and multi-region architecture are critical for the gaze estimation performance while their effectiveness dependent on the quality of the input face image. We obtain the state-of-the-art performances on three datasets with 3.64 on ETH-XGaze, 4.50 on MPIIFaceGaze, and 9.13 on Gaze360 degrees gaze estimation error by taking ResNet-50 as the backbone.

View on arXivView PDF

Code Implementations(1)

This repository contains frameworks for pre-processing, training and evaluating full face or multi-region (face, left and right eyes) gaze estimation models on the following three datasets: ETH-XGaze, MPII-Gaze, and Gaze360.

121PythonJul 5, 20232 years ago

Similar Papers

Cite this paper

@article{wang2023investigation,
  title  = {Investigation of Architectures and Receptive Fields for Appearance-based Gaze Estimation},
  author = {Yunhan Wang and Xiangwei Shi and Shalini De Mello and Hyung Jin Chang and Xucong Zhang},
  year   = {2023},
  eprint = {2308.09593},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2308.09593v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2308.09593.svg)](https://codeofpaper.com/paper/2308.09593)

Discussion