A constructive study of Markov equilibria in stochastic games with strategic complementarities.