Space Reduction for a Class of Multidimensional Markov Chains: A Summary and Some Applications.
Qi-Ming HeAttahiru Sule AlfaPublished in: INFORMS J. Comput. (2018)
Keyphrases
- markov chain
- space reduction
- probabilistic automata
- finite state
- steady state
- transition probabilities
- monte carlo
- state space
- markov processes
- markov process
- markov model
- stochastic process
- random walk
- stationary distribution
- monte carlo simulation
- finite automata
- transition matrix
- monte carlo method
- computer vision
- assemble to order systems
- finite state automata
- relative entropy
- non stationary
- search algorithm
- bayesian networks