Infor-Coef: Information Bottleneck-based Dynamic Token Downsampling for Compact and Efficient language model.

Published in: CoRR (2023)

Keyphrases

language model
language modeling
information bottleneck
n gram
probabilistic model
retrieval model
information retrieval
supervised learning
test collection
query expansion
query terms
mixture model
topic models
image registration
bayesian inference
knn
multi feature