Hello, @vmayoral 
Actually, It was helpful to me to refer https://github.com/erlerobot/gym-gazebo environments.
But, I used just gazebo for the simulation.
I absolutely agree with your advice and will find better policy.
Thanks for your interesting!