Absorption in Time-Varying Markov Chains: Graph-Based Conditions.
Yasin YaziciogluPublished in: IEEE Control. Syst. Lett. (2021)
Keyphrases
- markov chain
- finite state
- steady state
- transition probabilities
- state space
- monte carlo
- markov processes
- markov process
- stationary distribution
- monte carlo method
- random walk
- monte carlo simulation
- sufficient conditions
- stochastic process
- transition matrix
- markov model
- probabilistic automata
- learning algorithm
- sample path
- assemble to order systems