Toddlers' Active Gaze Behavior Supports Self-Supervised Object Learning

Zhengyang Yu, Arthur Aubret, Marcel C. Raabe, Jane Yang, Chen Yu +1 more
11/4/2024
cs.CVcs.AI

No confident code implementation found for this paper.

Abstract

Toddlers learn to recognize objects from different viewpoints with almost no supervision. During this learning, they execute frequent eye and head movements that shape their visual experience. It is presently unclear if and how these behaviors contribute to toddlers' emerging object recognition abilities. To answer this question, we here combine head-mounted eye tracking during dyadic play with unsupervised machine learning. We approximate toddlers' central visual field experience by cropping image regions from a head-mounted camera centered on the current gaze location estimated via eye tracking. This visual stream feeds an unsupervised computational model of toddlers' learning, which constructs visual representations that slowly change over time. Our experiments demonstrate that toddlers' gaze strategy supports the learning of invariant object representations. Our analysis also shows that the limited size of the central visual field where acuity is high is crucial for this. Overall, our work reveals how toddlers' gaze behavior may support their development of view-invariant object recognition.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. Any repos shown below are weak matches — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

Cite this paper

@article{yu2024toddlers,
  title  = {Toddlers' Active Gaze Behavior Supports Self-Supervised Object Learning},
  author = {Zhengyang Yu and Arthur Aubret and Marcel C. Raabe and Jane Yang and Chen Yu and Jochen Triesch},
  year   = {2024},
  eprint = {2411.01969},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2411.01969v3}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2411.01969.svg)](https://codeofpaper.com/paper/2411.01969)

Discussion