A Revisit of Block Power Methods for Finite State Markov Chain Applications.
Hao JiSeth H. WeinbergYaohang LiPublished in: CoRR (2016)
Keyphrases
- markov chain
- finite state
- monte carlo method
- monte carlo simulation
- steady state
- monte carlo
- transition probabilities
- markov decision processes
- stochastic process
- markov process
- optimal policy
- random walk
- state space
- markov model
- stationary distribution
- bayesian framework
- partially observable markov decision processes