Language model compression with weighted low-rank factorization.

Yen-Chang Hsu Ting Hua Sungen Chang Qian Lou Yilin Shen Hongxia Jin

Published in: ICLR (2022)

Keyphrases

low rank
language model
matrix factorization
language modeling
missing data
singular value decomposition
linear combination

convex optimization
probabilistic model
low rank matrix
query expansion
n gram
semi supervised
matrix completion

high dimensional data
information retrieval
rank minimization
non rigid structure from motion
high order
retrieval model
data matrix

test collection
factorization methods
query terms
generative model
data sets
mixture model