-spectral gap for discrete Markov chains with band transition matrices.
Loïc HervéJames LedouxPublished in: J. Appl. Probab. (2016)
Keyphrases
- markov chain
- transition matrices
- markov processes
- markov decision processes
- steady state
- transition probabilities
- finite state
- state space
- monte carlo
- markov decision process
- markov process
- random walk
- markov decision problems
- stationary distribution
- probabilistic automata
- markov model
- transition matrix
- reinforcement learning
- optimal policy
- state transition
- finite automata
- higher order
- markov models
- bayesian networks
- finite number