A Multi-Level Solution Algorithm for Steady-State Markov Chains.
Graham HortonScott T. LeuteneggerPublished in: SIGMETRICS (1994)
Keyphrases
- steady state
- markov chain
- markov model
- monte carlo
- optimal solution
- finite state
- learning algorithm
- objective function
- markov process
- markov chain monte carlo
- state space
- probabilistic model
- dynamic programming
- arrival rate
- parameter estimation
- mathematical model
- probabilistic automata
- stochastic process
- state dependent
- algo rithm
- explicit expressions
- genetic regulatory networks
- finite state automata
- product form
- queueing model
- heavy traffic
- asymptotically optimal
- transition probabilities
- sufficient conditions
- regular expressions
- random walk