Llama_ros (llama.cpp for ROS 2)

ROS Projects
,
1

Hello everyone,
I have created llama_ros which integrates llama.cpp into ROS 2.
You can use LLM models such as alpaca and gpt4all inside your ROS 2 projects.

11 Likes
2

I found your repo about a week ago and have been trying to get it runing on my Jetson Xavier… I am also trying to run it in a docker container… i am also excited about your Chatbot ros package… hopefully i can get that whole pipeline running! Great Work!

3

@mgonzs13 Great and amazing work! thanks for sharing this :+1:

I have been working on personal hobby project with OpenAI API

and have been exploring embedded LLM.

I definitely check this out :rocket: :rocket: :rocket:

Tomoya