BERTnesia: Investigating the capture and forgetting of knowledge in BERT.

Jonas Wallat Jaspreet Singh Avishek Anand

Published in: CoRR (2020)

Keyphrases

domain knowledge
prior knowledge
knowledge base
decision trees
knowledge extraction
knowledge sources
domain experts
hidden markov models
subject matter
knowledge sharing
background knowledge
knowledge acquisition
data mining
expert systems
multi agent
image sequences
high level
information retrieval