I did find https://github.com/facebook/osquery/issues/3303, which suggests I could use

--tls_hostname localhost:8080 \
     --tls_server_certs ./tools/tests/test_server_ca.pem \

as flags. I could always go that route unless I can specify it in the options of the config