The Information Pathways Hypothesis: Transformers are Dynamic Self-Ensembles.

Md. Shamim Hussain Mohammed J. Zaki Dharmashankar Subramanian

Published in: CoRR (2023)

Keyphrases

structural information
higher level
learning algorithm
decision trees
multi class
information sources
information fusion
neural network
prior knowledge
domain knowledge
end users
dynamic environments
contextual information
partial information