So you think disk usage is the same or does the isolated build duplicate copies of dependencies?
Have you looked into making the docker images run the local_setup.bash file as part of the image compilation so that it doesn’t require any time during image startup?