Entropy Loss: An Interpretability Amplifier of 3D Object Detection Network for Intelligent Driving

Haobo Yang, Shiyan Zhang, Zhuoyi Yang, Xinyu Zhang, Jilong Guo +2 more
9/1/2024
cs.CVcs.AIcs.IT

No official code found. Best implementation: yhbcode000/mmdetection3d-eloss-neuralps (1 star, Apache-2.0, last commit 2025-12-08).

Abstract

With the increasing complexity of the traffic environment, the significance of safety perception in intelligent driving is intensifying. Traditional methods in the field of intelligent driving perception rely on deep learning, which suffers from limited interpretability, often described as a "black box." This paper introduces a novel type of loss function, termed "Entropy Loss," along with an innovative training strategy. Entropy Loss is formulated based on the functionality of feature compression networks within the perception model. Drawing inspiration from communication systems, the information transmission process in a feature compression network is expected to demonstrate steady changes in information volume and a continuous decrease in information entropy. By modeling network layer outputs as continuous random variables, we construct a probabilistic model that quantifies changes in information volume. Entropy Loss is then derived based on these expectations, guiding the update of network parameters to enhance network interpretability. Our experiments indicate that the Entropy Loss training strategy accelerates the training process. Utilizing the same 60 training epochs, the accuracy of 3D object detection models using Entropy Loss on the KITTI test set improved by up to 4.47\% compared to models without Entropy Loss, underscoring the method's efficacy. The implementation code is available at https://github.com/yhbcode000/Eloss-Interpretability.

View on arXivView PDF

Code Implementations(1)

Apache-2.0

An Interpretability amplifier or metrics of deep leanring models.

11C++, CudaJun 28, 202310 months agoApache-2.0

Similar Papers

Cite this paper

@article{yang2024entropy,
  title  = {Entropy Loss: An Interpretability Amplifier of 3D Object Detection Network for Intelligent Driving},
  author = {Haobo Yang and Shiyan Zhang and Zhuoyi Yang and Xinyu Zhang and Jilong Guo and Zongyou Yang and Jun Li},
  year   = {2024},
  eprint = {2409.00839},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2409.00839v2}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2409.00839.svg)](https://codeofpaper.com/paper/2409.00839)

Discussion