Transients in Markov Chains.
Jack SklanskyKenneth R. KaplanPublished in: IEEE Trans. Electron. Comput. (1963)
Keyphrases
- markov chain
- steady state
- transition probabilities
- monte carlo
- finite state
- random walk
- stochastic process
- state space
- markov model
- stationary distribution
- markov process
- monte carlo method
- monte carlo simulation
- probabilistic automata
- sample path
- markov processes
- transition matrix
- grammatical inference
- single server
- information theory
- probability distribution
- reinforcement learning