States Hidden in Hidden States: LLMs Emerge Discrete State Representations Implicitly.

Junhao Chen Shengding Hu Zhiyuan Liu Maosong Sun

Published in: CoRR (2024)

Keyphrases

hidden states
hidden markov models
hidden variables
conditional random fields
dynamic bayesian networks
hidden state
exponential family
generative model
markov models
machine learning
bayesian networks
probabilistic model
expectation maximization