Awesome list of foundation model projects in ROS

ROS Projects
,
1

Following my ROSCon talk on a survey of building foundation model-powered robots in ROS, I’ve condensed different projects discussed during my presentation into an awesome list, and added some more. Hope this list serves as a helpful resource for anyone exploring the use of foundation models in ROS. Contributions, suggestions, and PRs are welcome to keep this list comprehensive and up-to-date!

Check it out: GitHub - ycheng517/awesome-foundation-model-ros

9 Likes
2

Many thanks for this.

I’m searching for a good, active forum or community where I can ask questions and get guidance on working with robotics foundational models, particularly for solving specific problems.

In my case, I want to implement an active visual search functionality that controls a camera to detect anomalies inside an industrial poultry shed. This involves dynamically adjusting the camera’s position based on visual feedback, which is somewhat related to visual servoing but with an added exploration component—actively searching the environment rather than tracking a fixed target.

I’m particularly interested in existing ROS 2 projects that leverage foundational models for active perception, anomaly detection, or intelligent camera control. If anyone knows of ROS 2-based solutions, relevant repositories, or communities discussing these topics, I’d love to hear your recommendations!

Thanks in advance!