O Programa de Pós Graduação do Departamento de Estatística informa sobre o Seminario - Assessing information flow in Deep Neural Networks via entropy.

Data do evento : 22 de abril de 2025

Horário: 14hrs

Local: Sala AT 76/7 - Multiuso do Departamento de Estatística. .

Palestrante : Alberto Ohashi do Departamento de Matemática da UnB

Abstract- In this talk, we will discuss some tools for assessing numerically the information contained in the layers of a Feedforward Neural Network. Each layer output can be seen as a signal whose entropy can be evaluated. Necessary conditions for the entropy flow to be decreasing are provided. Mutual information is used to describe quantitatively the information conveyed by one layer about another layer. The invariance property and data processing inequalities regarding the mutual information are discussed and used in applications to Deep Neural Networks.