Optimal bounds for bit-sizes of stationary distributions in finite Markov chains.
Mateusz SkomraPublished in: CoRR (2021)
Keyphrases
- markov chain
- stationary distribution
- state dependent
- markov process
- steady state
- transition probabilities
- product form
- finite state
- random walk
- state space
- queueing networks
- markov processes
- stochastic process
- initial state
- dynamic programming
- markov model
- transition matrix
- single server
- queue length
- optimal control
- markov models
- pseudorandom
- network architecture
- probabilistic automata