The Big-O Problem for Labelled Markov Chains and Weighted Automata.
Dmitry ChistikovStefan KieferAndrzej S. MurawskiDavid PurserPublished in: CONCUR (2020)
Keyphrases
- markov chain
- probabilistic automata
- finite state
- finite automata
- steady state
- transition probabilities
- state space
- monte carlo method
- random walk
- monte carlo
- relative entropy
- transition matrix
- markov model
- markov process
- stationary distribution
- markov processes
- stochastic process
- finite state automata
- monte carlo simulation
- queueing theory
- objective function
- sample path
- mutual information