Language model compression with weighted low-rank factorization.
Yen-Chang HsuTing HuaSungen ChangQian LouYilin ShenHongxia JinPublished in: ICLR (2022)
Keyphrases
- low rank
- language model
- matrix factorization
- language modeling
- missing data
- singular value decomposition
- linear combination
- convex optimization
- probabilistic model
- low rank matrix
- query expansion
- n gram
- semi supervised
- matrix completion
- high dimensional data
- information retrieval
- rank minimization
- non rigid structure from motion
- high order
- retrieval model
- data matrix
- test collection
- factorization methods
- query terms
- generative model
- data sets
- mixture model