Phase Transitions for Controlled Markov Chains on Infinite Graphs.
Naoyuki IchiharaPublished in: SIAM J. Control. Optim. (2016)
Keyphrases
- markov chain
- phase transition
- random graphs
- steady state
- random constraint satisfaction problems
- satisfiability problem
- constraint satisfaction
- transition probabilities
- markov model
- finite state
- monte carlo
- hard problems
- randomly generated
- stationary distribution
- markov processes
- random walk
- markov process
- np complete
- cellular automata
- state space
- graph coloring
- stochastic process
- transition matrix
- graph theoretic
- sat problem
- probabilistic automata
- graph matching
- random instances
- spanning tree
- reinforcement learning
- directed graph
- parameter estimation
- special case