I wrote a ROS node which captures the webcam stream with opencv and then i added two “images” above the webcam image.The first “image” is 50x50 pixels and shows the command. The second “image” is 32x512 pixels. I choose this, because the webcam video is 640x480 pixels, and so i can simply add 16 arrays of 1024 pixels. Then the webcam image is the third image. This image stream i then publish and can simply see it in rviz.
You can see the 16 black pixels above the webcam image and under the command-image. But as you can see, they are only pixels and not good to see, so my question is now, would a convnet be able to “see” and keep apart these pixels, or are they too small?