Compressing Pre-trained Transformers via Low-Bit NxM Sparsity for Natural Language Understanding.

Connor Holmes Minjia Zhang Yuxiong He Bo Wu

Published in: CoRR (2022)

Keyphrases

natural language understanding
pre trained
natural language
semantic analysis
language understanding
knowledge representation
natural language processing
training data
training examples
dialogue system
spoken dialog systems
neural network
high level
face recognition
control signals