It's convenient to have built libs available, but we could live without it. On a previous gig, I had the dependent libs in a separate repo. Build that repo, and the agent build refers to them. The agent build can also use the build artifacts from the dependency repo CI build.