The Markov-Chain Polytope with Applications.
Mordecai J. GolinAlbert John Lalim PatupatPublished in: CoRR (2024)
Keyphrases
- markov chain
- steady state
- finite state
- monte carlo method
- random walk
- monte carlo
- markov process
- state space
- transition probabilities
- transition matrix
- stochastic process
- stationary distribution
- directed graph
- monte carlo simulation
- markov model
- least squares
- neural network
- higher order
- dynamic programming
- search algorithm