TinyBERT: Distilling BERT for Natural Language Understanding.
Xiaoqi JiaoYichun YinLifeng ShangXin JiangXiao ChenLinlin LiFang WangQun LiuPublished in: CoRR (2019)
Keyphrases
- natural language understanding
- semantic analysis
- natural language
- text understanding
- knowledge representation
- natural language processing
- semantic representations
- language understanding
- spoken dialog systems
- joint inference
- dialogue system
- abductive reasoning
- semantic information
- language processing
- co occurrence
- prior knowledge
- metadata
- information retrieval
- databases