Introduction to ROBOTIS AI WORKER

Projects
,
1

Hello, everyone,

I’m excited to introduce you to ROBOTIS AI WORKER, an open-source, ROS 2 based mobile humanoid robot that leverages teleoperation and transformer-based imitation learning to perform real-world manipulation tasks. We’re pushing the boundaries of Physical AI, making complex robot behaviors accessible through intuitive human demonstrations.

ROBOTIS AI WORKER, Imitation Learning Demo

This video showcases the imitation learning pipeline for AI WORKER — starting from teleoperation-based data collection to data visualization and finally Model inference.

Our current policy is based on ACT(Action Chunking with Transformers), enabling the robot to understand and execute high-level behaviors from demonstration data.

:pushpin: In this video, you’ll see:

  1. Teleoperation for collecting demonstration data
  2. Visualization of the collected data
  3. Model inference using a trained transformer-based model

We begin with a simple pick-and-place task, but more complex manipulation behaviors are on the way.
Stay tuned as we continue to push the boundaries of physical AI in real-world robotics.

:robot: This project is built with ROS 2 and is fully open source.

:link: GitHub Repository:
:backhand_index_pointing_right: GitHub - ROBOTIS-GIT/ai_worker: AI Worker: FFW (Freedom From Work)
:backhand_index_pointing_right: GitHub - ROBOTIS-GIT/physical_ai_tools: physical_ai_tools

:light_bulb: This project makes use of open-source resources from ROS and HuggingFace LeRobot :hugs: — many thanks for sharing such valuable tools!

“ROBOTIS AI Worker Demo Showcase”

#ROBOTIS #AIWORKER #ImitationLearning teleoperation ros2 #Transformers #ActionChunking #RobotLearning #PhysicalAI #HuggingFace #LeRobot #OpenSource

5 Likes
2

Thanks. But I dont find the 3d models? Where are they? And the boom list?

3

You can find the relevant model files here:

Please note that in most ROS packages, the model files are typically stored within the *_description package.

If you’re specifically looking for MuJoCo files, please refer to the following repository:

Kindly be aware that some components in the MuJoCo models may still be incomplete and could be updated in the future.

1 Like