(Safe) SMART Hands: Hand Activity Analysis and Distraction Alerts Using a Multi-Camera Framework

Ross Greer, Lulua Rakla, Anish Gopalan, Mohan Trivedi
1/14/2023
cs.CVcs.AIcs.HC

No confident code implementation found for this paper.

Abstract

Manual (hand-related) activity is a significant source of crash risk while driving. Accordingly, analysis of hand position and hand activity occupation is a useful component to understanding a driver's readiness to take control of a vehicle. Visual sensing through cameras provides a passive means of observing the hands, but its effectiveness varies depending on camera location. We introduce an algorithmic framework, SMART Hands, for accurate hand classification with an ensemble of camera views using machine learning. We illustrate the effectiveness of this framework in a 4-camera setup, reaching 98% classification accuracy on a variety of locations and held objects for both of the driver's hands. We conclude that this multi-camera framework can be extended to additional tasks such as gaze and pose analysis, with further applications in driver and passenger safety.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. Any repos shown below are weak matches — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

Ensemble Learning for Fusion of Multiview Vision with Occlusion and Missing Information: Framework and Evaluations with Real-World Data and Applications in Driver Hand Activity Recognition

85% match2023

A Multimodal RGB and Events Dataset for Hand Detection in First-Person View

84% match2026

Self-supervised Optimization of Hand Pose Estimation using Anatomical Features and Iterative Learning

84% match2023

Object Detection Approaches to Identifying Hand Images with High Forensic Values

83% match2024

REACH: Hand Pose Estimation from Room Corners

83% match2026

N-DriverMotion: Driver motion learning and prediction using an event-based camera and directly trained spiking neural networks on Loihi 2

82% match2024

Cite this paper

@article{greer2023safe,
  title  = {(Safe) SMART Hands: Hand Activity Analysis and Distraction Alerts Using a Multi-Camera Framework},
  author = {Ross Greer and Lulua Rakla and Anish Gopalan and Mohan Trivedi},
  year   = {2023},
  eprint = {2301.05838},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2301.05838v3}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2301.05838.svg)](https://codeofpaper.com/paper/2301.05838)

Discussion