Keyphrases
- markov chain
- state space
- steady state
- markov process
- stochastic process
- transition probabilities
- finite state
- stationary distribution
- monte carlo
- monte carlo method
- monte carlo simulation
- markov model
- markov processes
- dynamic programming
- transition matrix
- probabilistic automata
- confidence intervals
- sample path
- information theoretic
- search space
- queueing theory