Finding Provably Optimal Markov Chains.

Jip Spel Sebastian Junges Joost-Pieter Katoen

Published in: TACAS (1) (2021)

Keyphrases

markov chain
steady state
finite state
monte carlo method
transition probabilities
monte carlo
stochastic process
markov process
monte carlo simulation
state space
random walk
markov model
probabilistic automata
markov processes
stationary distribution
transition matrix
queueing theory
sample path
algo rithm