Non-linear smoothers for discrete-time, finite-state Markov chains.
Daphney-Stavroula ZoisMarco LevoratoUrbashi MitraPublished in: ISIT (2013)
Keyphrases
- finite state
- markov chain
- steady state
- markov processes
- monte carlo
- transition probabilities
- markov process
- state space
- random walk
- markov model
- stochastic process
- stationary distribution
- average cost
- continuous state
- transition matrix
- machine learning
- probabilistic automata
- partially observable markov decision processes
- search algorithm