Using the exact state space of a Markov model to compute approximate stationary measures.
Andrew S. MinerGianfranco CiardoSusanna DonatelliPublished in: SIGMETRICS (2000)
Keyphrases
- markov model
- state space
- markov chain
- markov models
- hidden markov models
- exact solution
- particle filter
- non stationary
- statistical model
- markov decision processes
- exact and approximate
- dynamic programming
- optimal policy
- markov decision process
- approximate matches
- search space
- reinforcement learning
- markov networks
- probabilistic model
- computer vision