From Markov Chains to Nonequilibrium Particle Systems (Mu Fa Chen).

Published in: SIAM Rev. (1993)

Keyphrases

markov chain
steady state
monte carlo method
finite state
transition probabilities
markov process
monte carlo
markov model
stochastic process
state space
em algorithm
stationary distribution
markov processes
machine learning
dynamic programming
random walk