Adaptive formal approximations of Markov chains.
Alessandro AbateRoman AndriushchenkoMilan CeskaMarta KwiatkowskaPublished in: Perform. Evaluation (2021)
Keyphrases
- markov chain
- steady state
- transition probabilities
- finite state
- state space
- markov process
- markov processes
- stationary distribution
- monte carlo
- stochastic process
- monte carlo method
- monte carlo simulation
- markov model
- random walk
- probabilistic automata
- transition matrix
- random numbers
- queueing theory
- single server
- closed form
- non stationary
- hidden markov models
- learning algorithm