Improving time bounded reachability computations in interactive Markov chains.
Hassan HatefiHolger HermannsPublished in: Sci. Comput. Program. (2015)
Keyphrases
- markov chain
- state space
- steady state
- finite state
- transition probabilities
- monte carlo
- markov process
- stochastic process
- markov model
- random walk
- markov processes
- monte carlo simulation
- transition matrix
- probabilistic automata
- monte carlo method
- stationary distribution
- markov decision processes
- dynamic programming
- sample path
- search space
- learning algorithm