Some strong limit theorems for Markov chains on a special non-homogeneous tree.
Shaohua JinJian LiuNan LiYanping WanShuguang SunPublished in: ICNC (2010)
Keyphrases
- markov chain
- limit theorems
- confidence intervals
- steady state
- heavy traffic
- finite state
- stationary distribution
- markov process
- random walk
- transition probabilities
- monte carlo
- queue length
- state space
- stochastic process
- markov processes
- markov model
- single server
- probabilistic automata
- transition matrix
- dynamic programming
- reinforcement learning
- information theoretic
- hidden markov models