An Efficient Inference Framework for Early-exit Large Language Models.

Ruijie Miao Yihan Yan Xinshuo Yao Tong Yang

Published in: CoRR (2024)

Keyphrases

relevance model
language model
language modeling
query expansion
probabilistic model
language modelling
context dependent
topic models
document retrieval
speech recognition
n gram
test collection
information retrieval
ad hoc information retrieval
context sensitive
statistical language models
hidden markov models