Rethinking Softmax with Cross-Entropy: Neural Network Classifier as Mutual Information Estimator.
Zhenyue QinDongwoo KimPublished in: CoRR (2019)
Keyphrases
- cross entropy
- mutual information
- neural network
- maximum likelihood
- activation function
- feature selection
- error function
- information theoretic
- log likelihood
- multi layer perceptron
- training process
- image registration
- training data
- similarity measure
- artificial neural networks
- back propagation
- support vector machine
- decision trees
- neural network model
- feature space
- training set
- evaluation metrics
- radial basis function
- least squares
- feed forward
- fuzzy logic
- hidden layer
- scoring function
- ranking functions
- multilayer perceptron
- language modeling
- learning algorithm
- training algorithm
- fuzzy neural network
- feedforward neural networks
- machine learning
- support vector
- network architecture
- feature vectors
- gaussian mixture model
- expectation maximization
- language model
- information retrieval systems