I just released https://github.com/TensorSwarm/TensorSwarm which allows you to over 100 robots at the same time. At the moment Proximal Policy Optimization is used as it seems to provide the best results.
The backend is a ROS service so you should be able to adopt your robots pretty easily. I’d be also glad to provide you with some support.