Quantitative Coarse-Graining of Markov Chains.
Bastian HilderUpanshu SharmaPublished in: SIAM J. Math. Anal. (2024)
Keyphrases
- markov chain
- steady state
- finite state
- transition probabilities
- stationary distribution
- monte carlo
- markov process
- random walk
- monte carlo method
- state space
- markov model
- markov processes
- monte carlo simulation
- stochastic process
- probabilistic automata
- sample path
- genetic algorithm
- higher order
- reinforcement learning
- machine learning
- algo rithm