Absorption in Time-Varying Markov Chains: Graph-Based Conditions.
Yasin YaziciogluPublished in: CoRR (2020)
Keyphrases
- markov chain
- steady state
- transition probabilities
- finite state
- markov process
- monte carlo
- markov processes
- stochastic process
- monte carlo simulation
- state space
- stationary distribution
- markov model
- random walk
- sufficient conditions
- transition matrix
- probabilistic automata
- monte carlo method
- confidence intervals
- semi supervised
- dynamic programming
- assemble to order systems