An extensible approach for real-time bidding with model-free reinforcement learning.