An iterative algorithm for computing mean first passage times of Markov chains.

Published in: Appl. Math. Comput. (2015)

Keyphrases

markov chain
markov model
k means
dynamic programming
monte carlo simulation
monte carlo
search space
probabilistic model
state space
transition matrix
learning algorithm
finite state
higher order
search algorithm
optimal solution
objective function
similarity measure