1. hi there! Anyone seen this before? orbit log...
# fleet
d
1. hi there! Anyone seen this before? orbit log:
Copy code
Jul 26 13:43:12 XXX orbit[3993848]: 2024-07-26T13:43:12+03:00 ERR running config receivers error="RunConfigReceivers get config: POST /api/fleet/orbit/config received status 422 Validation Failed: Error 1243 (HY000): Unknown prepared statement handler (331) given to mysql_stmt_precheck"
POST request to /api/fleet/orbit/config returns
Copy code
{
  "message": "Validation Failed",
  "errors": [
    {
      "name": "base",
      "reason": "Error 1243 (HY000): Unknown prepared statement handler (331) given to mysql_stmt_precheck"
    }
  ]
}
./fleetctl debug
Copy code
{
  "count": 390,
  "chain": [
    {
      "message": "Error 1243 (HY000): Unknown prepared statement handler (157) given to mysql_stmt_precheck"
    },
    {
      "message": "find host",
      "data": {
        "timestamp": "2024-07-26T11:56:10Z"
      },
      "stack": [
        "github.com/fleetdm/fleet/v4/server/datastore/mysql.(*Datastore).LoadHostByOrbitNodeKey (hosts.go:2325)",
        "github.com/fleetdm/fleet/v4/server/service.(*Service).AuthenticateOrbitHost (orbit.go:104)",
        "github.com/fleetdm/fleet/v4/server/service.newOrbitAuthenticatedEndpointer.func1.authenticatedOrbitHost.1 (endpoint_middleware.go:132)",
        "github.com/fleetdm/fleet/v4/server/service.newOrbitAuthenticatedEndpointer.func1.authenticatedOrbitHost.logged.2 (endpoint_middleware.go:223)",
        "github.com/fleetdm/fleet/v4/server/service.newServer.newServer.(*Middleware).AuthzCheck.func1.func2 (authzcheck.go:31)",
        "github.com/go-kit/kit/transport/http.Server.ServeHTTP (server.go:121)",
        "github.com/prometheus/client_golang/prometheus/promhttp.InstrumentHandlerRequestSize.func2 (instrument_server.go:255)",
        "net/http.HandlerFunc.ServeHTTP (server.go:2166)",
        "github.com/prometheus/client_golang/prometheus/promhttp.InstrumentHandlerResponseSize.func1 (instrument_server.go:296)",
        "net/http.HandlerFunc.ServeHTTP (server.go:2166)",
        "github.com/prometheus/client_golang/prometheus/promhttp.InstrumentHandlerCounter.func1 (instrument_server.go:147)"
      ]
    },
    {
      "message": "authentication error orbit",
      "data": null,
      "stack": [
        "github.com/fleetdm/fleet/v4/server/service.(*Service).AuthenticateOrbitHost (orbit.go:111)"
      ]
    }
  ]
}
k
Hi @Den! Can you share your Fleet and MySQL versions?
d
Hi @Kathy Satterlee fleetdm/fleet:v4.52.0 mysql 8.0.2 fleet(tag: tf-mod-root-v1.10.0) installed on aws using terraform
k
When did this first pop up?
If you could share the full logs from the host, that would be useful as well, just to get the timeline sorted 🙂
d
It's a fresh deployment. I will add a new agent and share logs.
@Kathy Satterlee logs form new agent:
cloudwatch logs from aws ECS
also all hosts goes offline for a few minutes . I don’t know if it is related.