Dynamic Properties of Neural Learning in the Information-theoretic Plane.
Perambur S. NeelakantaSalahalddin T. AbusalahRaghavan SudhakarDolores F. De GroffValentine AaloJoseph C. ParkPublished in: Complex Syst. (1995)
Keyphrases
- distance measure
- information theoretic
- neural learning
- information theory
- mutual information
- kullback leibler divergence
- theoretic framework
- similarity measure
- information bottleneck
- information theoretic measures
- multi layered
- neural network
- relative entropy
- intelligent robots
- log likelihood
- multi modality
- minimum description length
- entropy measure
- jensen shannon divergence
- incremental learning
- markov random field
- multi class
- computational learning theory
- computer vision
- data mining