How Large Language Models Encode Context Knowledge? A Layer-Wise Probing Study.

Tianjie Ju Weiwei Sun Wei Du Xinwei Yuan Zhaochun Ren Gongshen Liu

Published in: CoRR (2024)

Keyphrases

language model
context sensitive
probabilistic model
n gram
language modeling
document retrieval
information retrieval
speech recognition
knowledge discovery
context dependent
language modelling
statistical language models