Rethinking Compression: Reduced order modelling of Latent Features in Large Language Models.

Arnav Chavan Nahush Lele Deepak Gupta

Published in: Tiny Papers @ ICLR (2024)

Keyphrases

language model
language modeling
reduced order
probabilistic model
language modelling
feature vectors
document retrieval
n gram
low level
retrieval model
speech recognition
test collection
mixture model
query expansion
feature extraction
machine learning
co occurrence
relevance model
feature space