Efficient State Classification of Finite State Markov Chains.
Aiguo XiePeter A. BeerelPublished in: DAC (1998)
Keyphrases
- finite state
- markov chain
- state space
- transition probabilities
- steady state
- markov process
- transition systems
- monte carlo
- random walk
- markov decision processes
- stochastic process
- markov model
- optimal policy
- markov processes
- partially observable markov decision processes
- text classification
- machine learning
- stationary distribution
- reinforcement learning
- probabilistic automata
- least squares
- state dependent
- completely independent
- queueing networks
- markov chain monte carlo
- non stationary
- similarity measure