State Space Exploration in Markov Models.
Edmundo de Souza e SilvaPedro Mejía OchoaPublished in: SIGMETRICS (1992)
Keyphrases
- markov models
- state space
- markov model
- higher order
- hidden markov models
- maximum entropy
- markov chain
- low order
- reinforcement learning
- transition probabilities
- sequence classification
- hidden state
- conditional random fields
- dynamical systems
- heuristic search
- markov decision processes
- particle filter
- partially observable
- search space
- sequence prediction
- statistical model
- optimal policy
- dynamic programming
- pairwise
- planning problems
- computational complexity
- image segmentation
- image processing