Can the fleet server be run behind a reverse proxy?

Yes. Check out this sweet article for guidance on this: https://defensivedepth.com/2020/04/02/kolide-fleet-breaking-out-the-osquery-api-web-ui/

Can confirm - I’m using Nginx in front of mine.