Numerical Experiments with Iteration and Aggregation for Markov Chains.
William J. StewartWei WuPublished in: INFORMS J. Comput. (1992)
Keyphrases
- markov chain
- steady state
- finite state
- transition probabilities
- random walk
- monte carlo
- state space
- markov model
- stochastic process
- markov process
- monte carlo simulation
- stationary distribution
- markov processes
- monte carlo method
- transition matrix
- probabilistic automata
- objective function
- sample path
- pattern matching
- confidence intervals
- maximum likelihood
- higher order
- assemble to order systems