TwinBERT: Distilling Knowledge to Twin-Structured Compressed BERT Models for Large-Scale Retrieval.
Wenhao LuJian JiaoRuofei ZhangPublished in: CIKM (2020)
Keyphrases
- prior knowledge
- image database
- statistical models
- data mining techniques
- expert systems
- domain knowledge
- information retrieval
- formal models
- knowledge acquisition
- image retrieval
- real world
- artificial neural networks
- conceptual models
- retrieval model
- learning algorithm
- background knowledge
- complex systems
- structured data
- learning systems
- web pages
- knowledge base
- knowledge management
- data structure
- knowledge discovery
- knowledge representation
- probabilistic model