From Multimodal to Unimodal Attention in Transformers using Knowledge Distillation.

Dhruv Agarwal Tanay Agrawal Laura M. Ferrari François Brémond

Published in: CoRR (2021)

Keyphrases

domain knowledge
knowledge base
knowledge representation
knowledge acquisition
visual attention
database
artificial intelligence
knowledge transfer
neural network
machine learning
case study
learning environment
natural language
prior knowledge
learning systems
concept maps