Distributed Markov Chains.
Ratul SahaJavier EsparzaSumit Kumar JhaMadhavan MukundP. S. ThiagarajanPublished in: VMCAI (2015)
Keyphrases
- markov chain
- steady state
- finite state
- transition probabilities
- monte carlo
- stochastic process
- markov model
- markov process
- markov processes
- stationary distribution
- random walk
- monte carlo simulation
- monte carlo method
- transition matrix
- state space
- probabilistic automata
- sample path
- assemble to order systems
- uniformly distributed
- markov random field
- search space
- search algorithm
- reinforcement learning
- machine learning