Efficient Softmax Approximation for Deep Neural Networks with Attention Mechanism.

Ihor Vasyltsov Wooseok Chang

Published in: CoRR (2021)

Keyphrases

neural network
attention mechanism
artificial neural networks
high resolution
activation function
computational complexity
multi modal
multilayer perceptron
biologically inspired