Structured Markov chains solver: tool extension.
Dario BiniBeatrice MeiniS. StefféBenny Van HoudtPublished in: VALUETOOLS (2009)
Keyphrases
- markov chain
- steady state
- finite state
- transition probabilities
- markov processes
- random walk
- stationary distribution
- markov model
- state space
- monte carlo simulation
- monte carlo method
- monte carlo
- probabilistic automata
- markov process
- stochastic process
- sample path
- higher order
- transition matrix
- pattern matching
- dynamic programming
- search algorithm
- machine learning