The development of a graphic multidimensional Markov Chain modeler to diagram large state spaces.
David Taylor-FullerSusan J. LinckePublished in: SpringSim (2009)
Keyphrases
- markov chain
- state space
- steady state
- transition probabilities
- state transition
- random walk
- markov process
- monte carlo
- finite state
- stationary distribution
- stochastic process
- monte carlo simulation
- markov model
- monte carlo method
- markov decision processes
- transition matrix
- maximum likelihood
- markov chain monte carlo
- higher order
- reinforcement learning
- genetic algorithm