Ok, so the trick was to source the package properly. Ament (the build tool) creates artifacts in the install folder with bunch of helper scripts.
All you need to do is to source it with . ./install/local_setup.bash. Now, ros2 pkg list will list the rospicam2 package.