Llama_ros (llama.cpp for ROS 2)

Hello everyone,
I have created llama_ros which integrates llama.cpp into ROS 2.
You can use LLM models such as alpaca and gpt4all inside your ROS 2 projects.

5 Likes