Towards quantifying information flows: relative entropy in deep neural networks and the renormalization group.
Johanna ErdmengerKevin T. GrosvenorRo JeffersonPublished in: CoRR (2021)
Keyphrases
- relative entropy
- information flows
- neural network
- information flow
- information theoretic
- log likelihood
- covariance matrix
- emergency response
- information theory
- team members
- organizational structure
- mutual information
- maximum entropy
- mahalanobis distance
- data warehouse
- kullback leibler divergence
- bregman divergences
- multi class
- information systems