Login / Signup
Knowledge Distillation vs. Pretraining from Scratch under a Fixed (Computation) Budget.
Minh Duc Bui
Fabian David Schmidt
Goran Glavas
Katharina von der Wense
Published in:
CoRR (2024)
Keyphrases
</>
domain knowledge
knowledge base
neural network
expert systems
prior knowledge
case study
knowledge representation
knowledge discovery
data mining techniques
reasoning process
database
knowledge transfer
concept maps
conceptual framework
domain ontology
learning algorithm
information retrieval
databases
data sets