Accurately Computing Expected Visiting Times and Stationary Distributions in Markov Chains.
Hannah MertensJoost-Pieter KatoenTim QuatmannTobias WinklerPublished in: CoRR (2024)
Keyphrases
- markov chain
- stationary distribution
- markov process
- random walk
- steady state
- product form
- transition probabilities
- finite state
- state dependent
- markov model
- stochastic process
- state space
- transition matrix
- markov processes
- queue length
- sufficient conditions
- service times
- initial state
- queueing networks
- bayesian networks