A simulation-based method for aggregating Markov chains.

Kun Deng Prashant G. Mehta Sean P. Meyn

Published in: CDC (2009)

Keyphrases

markov chain
monte carlo simulation
objective function
pairwise
markov model
random numbers
learning algorithm
similarity measure
dynamic programming
steady state
density estimation
stationary distribution
transition matrix
probabilistic automata