I modified the config file to move logging from /tmp/osquery_results to a different directory, then restarted. After restart we started getting handshake errors.
But I think I have resolved the issue, we originally stood this up for Kolide and when we migrated over to FleetDM. Used Certbot to create the cert, and just kept the same certs when we moved to Fleetdm and it renewed on Dec29th.