Keyphrases
- error bounds
- markov chain
- steady state
- theoretical analysis
- finite state
- transition probabilities
- state space
- random walk
- markov process
- stochastic process
- monte carlo
- monte carlo method
- markov model
- monte carlo simulation
- stationary distribution
- worst case
- transition matrix
- probabilistic automata
- markov processes
- reinforcement learning