Rounding errors in certain algorithms involving Markov chains.

Winfried K. Grassmann

Published in: ACM Trans. Math. Softw. (1993)

Keyphrases

markov chain
steady state
transition probabilities
markov processes
learning algorithm
finite state
markov process
random walk
monte carlo
optimal solution
dynamic programming
monte carlo simulation
probabilistic automata
weighted sums