Low-order approximations of Markov chains in a decision theoretic context (Corresp.).
Dimitri KazakosPublished in: IEEE Trans. Inf. Theory (1980)
Keyphrases
- low order
- markov chain
- decision theoretic
- markov models
- markov model
- high order
- transition probabilities
- higher order
- steady state
- finite state
- random walk
- numerical solution
- markov processes
- linear combination
- probabilistic automata
- state space
- stationary distribution
- hidden markov models
- statistical model
- transition matrix
- point cloud
- finite automata
- reinforcement learning
- graphical models
- search algorithm