Deep Reinforcement Learning Applied to IEEE Very Small Size Soccer Strategy**This work was supported by ITAndroids' sponsors: Altium Cenic, Intel, ITAEx, MathWorks, Metinjo, Micropress, Polimold, Rapid, SolidWorks, STMicroelectronics, Wildlife Studios and Vir-tual. PYXIS. Also, Thiago Filipe de Medeiros would like to thank Capes for the master's scholarship grant 88882.446989/2019-01 and Takashi Yoneyama would like to thank CNPq - National Research Council of Brazil for the grant 304134/2018-0.