Randomized Finite-State Distributed Algorithms as Markov Chains.
Marie DuflotLaurent FribourgClaudine PicaronnyPublished in: DISC (2001)
Keyphrases
- finite state
- markov chain
- partially observable markov decision processes
- markov chain monte carlo
- steady state
- random walk
- monte carlo
- markov model
- learning algorithm
- stochastic process
- model checking
- markov decision processes
- markov process
- transition probabilities
- optimal policy
- state space
- average cost
- stationary distribution
- continuous state
- distributed systems
- policy iteration
- probability distribution
- markov processes
- algo rithm
- transition matrix
- pattern matching
- dynamic programming