State Space Orderings for Gauss-Seidel in Markov Chains Revisited.
Tugrul DayarPublished in: SIAM J. Sci. Comput. (1998)
Keyphrases
- markov chain
- state space
- gauss seidel
- steady state
- monte carlo
- finite state
- transition probabilities
- reinforcement learning
- convergence speed
- dynamic programming
- stationary distribution
- random walk
- markov decision processes
- monte carlo method
- optimal policy
- markov process
- markov model
- stochastic process
- state variables
- particle filter
- search space
- markov decision process
- markov processes
- dynamical systems
- transition matrix
- initial state
- belief state
- probabilistic automata