GaussianRPG v2.0 has been launched!!The first open-source hardware-in-the-loop simulation system demo using 3D Gaussian Splatting tech.
(GitHub - GimpelZhang/GaussianRPG: 3D Gaussian Rendering PlayGround: an open-source autonomous driving closed-loop simulator demo using 3D Gaussian Splatting tech)
In v2.0 version, a hardware-in-the-loop simulation system demo is developed based on v1.0 and a D-Robotics RDK X5 suite, similar to the RaspBerry PI (https://developer.d-robotics.cc/rdk_doc/en/RDK).
The other key part of the HIL system is the image stream injection device, which simulates the camera. I find a chip suite which works as a HDMI to USB converter. So this RER-H2U-V2 chip can take the image stream from HDMI as input, and output it through USB interface, working as an USB camera connected to the RDK suite.
I believe that this kind of 3DGS simulator and robot-controller-in-the-loop frame can also be used in embodied intelligence robot simulation.