Keyphrases
- finite state
- markov chain
- model checking
- markov decision processes
- weight matrices
- optimal policy
- hidden markov models
- vector quantizer
- action sets
- average cost
- search algorithm
- transition systems
- linear programming
- policy iteration
- biological sequences
- tree automata
- finite state transducers
- maximum likelihood
- objective function
- continuous time markov process