Triangular M/G/1-Type and Tree-Like Quasi-Birth-Death Markov Chains.
Benny Van HoudtJohan van LeeuwaardenPublished in: INFORMS J. Comput. (2011)
Keyphrases
- markov chain
- steady state
- stationary distribution
- state dependent
- markov processes
- transition probabilities
- single server
- monte carlo
- random walk
- finite state
- markov process
- monte carlo method
- markov model
- state space
- queueing systems
- probabilistic automata
- monte carlo simulation
- transition matrix
- queueing networks
- stochastic process
- service times
- queue length
- reinforcement learning
- confidence intervals
- heavy traffic
- spanning tree
- queueing model
- maximum likelihood
- dynamic programming