Keyphrases
- markov chain
- steady state
- markov chain monte carlo
- monte carlo
- monte carlo method
- finite state
- stationary distribution
- random walk
- markov process
- transition probabilities
- transition matrix
- stochastic process
- state space
- markov model
- markov processes
- monte carlo simulation
- probabilistic automata
- bayesian learning
- bayesian networks
- posterior probability
- maximum likelihood
- gibbs sampling
- bayesian inference
- confidence intervals
- posterior distribution
- parameter estimation
- graphical models
- machine learning