Please try connecting directly to the Fleet server rather than through the LB. If that works, the problem is very likely your LB.

Finally solved the problem. It was redis connectivity issue. But ideally caching should be non-intrusive.