Keyphrases
- markov chain
- transition probabilities
- transition matrix
- state transition
- steady state
- finite state
- state space
- stationary distribution
- markov process
- random walk
- markov model
- monte carlo method
- stochastic process
- monte carlo
- markov models
- monte carlo simulation
- markov processes
- probabilistic automata
- sample path
- initial state
- multispectral
- hidden markov models
- machine learning