Construction of Lyapunov functions for piecewise-deterministic Markov processes.

Alexandre Rodrigues Mesquita João Pedro Hespanha

Published in: CDC (2010)

Keyphrases

markov processes
markov process
markov chain
stochastic processes
non stationary
continuous time bayesian networks
sufficient conditions
random fields
continuous time markov chains
dynamical systems
image processing
image segmentation
reinforcement learning
random walk
basis functions
nonlinear functions