On the absorption probabilities and mean time for absorption for discrete Markov chains.
Nikolaos HalidiasPublished in: Monte Carlo Methods Appl. (2021)
Keyphrases
- markov chain
- transition probabilities
- markov processes
- steady state
- finite state
- markov process
- stationary distribution
- random walk
- markov model
- monte carlo method
- stochastic process
- monte carlo
- state space
- sample path
- probabilistic automata
- monte carlo simulation
- markov models
- random numbers
- confidence intervals
- dynamic programming
- transition matrix
- parameter estimation
- queueing theory