On the Structure of Nearly Uncoupled Markov Chains.
G. W. StewartPublished in: Computer Performance and Reliability (1983)
Keyphrases
- markov chain
- steady state
- transition probabilities
- stochastic process
- random walk
- monte carlo
- markov processes
- markov model
- finite state
- markov process
- state space
- monte carlo method
- stationary distribution
- probabilistic automata
- stochastic processes
- confidence intervals
- bayesian networks
- higher order
- sample path
- transition matrix
- machine learning