Markov property of Markov chains and its test.
Yu-Fen ZhangQun-Feng ZhangRui-Hua YuPublished in: ICMLC (2010)
Keyphrases
- markov chain
- markov property
- state space
- steady state
- markov process
- transition probabilities
- finite state
- markov processes
- stationary distribution
- markov model
- stochastic process
- random walk
- transition matrix
- probabilistic automata
- markov models
- random variables
- random numbers
- reinforcement learning
- conditional random fields
- particle filter
- spatio temporal
- pairwise