Singularly Perturbed Discrete-Time Markov Chains.
Gang George YinQing ZhangPublished in: SIAM J. Appl. Math. (2000)
Keyphrases
- markov chain
- finite state
- markov processes
- steady state
- state space
- stationary distribution
- monte carlo
- transition probabilities
- random walk
- markov process
- markov model
- stochastic process
- monte carlo simulation
- monte carlo method
- transition matrix
- sample path
- probabilistic model
- probabilistic automata
- mutual information
- markov models
- weighted sum
- reinforcement learning
- assemble to order systems