Also the page where fleet is has an oauth setup in front

That sounds like an issue. Osquery clients will not be able to complete oauth. You need to allow any

/api/v1/osquery/*

endpoints to be accessible with no oauth.