Any guides of setting up Azure as SSO in Fleet?

Not for Azure in particular, but the process tends to be quite similar across providers: https://fleetdm.com/docs/deploying/configuration#configuring-single-sign-on-sso