Manipulation of State Transition Matrices of Finite Markov Chains.

S. C. Gupta J. J. O'Donnell

Published in: IEEE Trans. Electron. Comput. (1963)

Keyphrases

markov chain
transition probabilities
state space
transition matrices
steady state
finite state
markov decision processes
markov process
random walk
monte carlo
markov processes
stationary distribution
markov model
markov decision process
state transition
probabilistic automata
markov decision problems