Temporal Markov Chain.

Peng Zhang Sabu Emmanuel Mohan S. Kankanhalli

Published in: MMM (2) (2011)

Keyphrases

markov chain
steady state
transition probabilities
monte carlo
finite state
monte carlo method
markov process
state space
random walk
markov model
stationary distribution
monte carlo simulation
stochastic process
transition matrix
markov chain monte carlo
markov models
dynamic programming
search algorithm