Matrix-geometric solutions of M/G/1-type Markov chains: a unifying generalized state-space approach.
Nail AkarNihat Cem OguzKhosrow SohrabyPublished in: IEEE J. Sel. Areas Commun. (1998)
Keyphrases
- markov chain
- state space
- steady state
- transition matrix
- stationary distribution
- finite state
- state dependent
- single server
- continuous time markov process
- transition probabilities
- markov processes
- markov process
- stochastic process
- dynamic programming
- monte carlo
- random walk
- queueing systems
- reinforcement learning
- monte carlo method
- markov model
- monte carlo simulation
- stochastic processes
- markov decision processes
- search space
- queue length
- queueing model
- state variables
- optimal policy
- initial state
- probabilistic automata
- queueing networks
- heavy traffic
- service times
- particle filter
- optimal solution
- assemble to order systems
- markov models
- markov decision process
- infinite horizon
- learning algorithm
- sufficient conditions
- query language
- bayesian networks