Efficient state classification of finite-state Markov chains.
Aiguo XiePeter A. BeerelPublished in: IEEE Trans. Comput. Aided Des. Integr. Circuits Syst. (1998)
Keyphrases
- finite state
- markov chain
- transition probabilities
- state space
- steady state
- markov decision processes
- markov process
- monte carlo
- markov processes
- transition systems
- random walk
- stationary distribution
- markov model
- machine learning
- continuous state
- text classification
- average cost
- completely independent
- transition matrix
- stochastic process
- model checking
- partially observable markov decision processes
- markov chain monte carlo
- probabilistic automata
- optimal policy