A sufficient condition of nonergodicity of a Markov chain (Corresp.).
Michael KaplanPublished in: IEEE Trans. Inf. Theory (1979)
Keyphrases
- sufficient conditions
- markov chain
- steady state
- finite state
- markov process
- state space
- transition probabilities
- stationary distribution
- monte carlo
- markov model
- transition matrix
- monte carlo method
- monte carlo simulation
- random walk
- exponential stability
- lyapunov function
- optimal policy
- pairwise
- linear complementarity problem
- search algorithm
- uniform convergence
- reinforcement learning
- image segmentation