Strong law of large numbers and Shannon-McMillan theorem for Markov chain fields on trees.
Weiguo YangWen LiuPublished in: IEEE Trans. Inf. Theory (2002)
Keyphrases
- markov chain
- steady state
- transition probabilities
- finite state
- monte carlo method
- random walk
- monte carlo simulation
- monte carlo
- state space
- markov process
- stochastic process
- stationary distribution
- markov model
- decision trees
- information theory
- transition matrix
- markov chain monte carlo
- dynamic programming
- prior knowledge