Non-deterministic weighted automata evaluated over Markov chains.
Jakub MichaliszynJan OtopPublished in: J. Comput. Syst. Sci. (2020)
Keyphrases
- markov chain
- probabilistic automata
- finite state
- steady state
- transition probabilities
- monte carlo
- random walk
- finite automata
- markov process
- state space
- monte carlo method
- monte carlo simulation
- markov model
- markov processes
- finite state automaton
- transition matrix
- stationary distribution
- stochastic process
- relative entropy
- turing machine
- markov decision processes
- finite state automata
- sample path
- cost sensitive
- dynamic programming