Bounded state space truncation and Censored Markov chains.
Ana BusicHilal DjafriJean-Michel FourneauPublished in: CDC (2012)
Keyphrases
- markov chain
- state space
- steady state
- transition probabilities
- finite state
- reinforcement learning
- stochastic process
- monte carlo
- dynamic programming
- markov process
- random walk
- stationary distribution
- markov decision processes
- markov model
- markov processes
- state variables
- optimal policy
- monte carlo simulation
- dynamical systems
- monte carlo method
- markov decision process
- transition matrix
- particle filter
- state transition
- probabilistic automata
- data mining
- assemble to order systems
- belief state
- higher order
- search space
- search algorithm
- bayesian networks