Having added >10k hosts to kolide fleet the hos...
# kolide
d
Having added >10k hosts to kolide fleet the hosts/manage page often pops up with "It's Kinda Lonely In Here..." when it seems to timeout fetching host information. Is this a known limitation with the web UI or is there something that can be tuned to improve page load speed? The call that seems to be really slow is to api/v1/kolide/hosts. Any thoughts please?
z
Yeah, it's a well-known problem. I have a fix for it that I worked on with a client and trying to get through the final steps to contributing those back upstream.
d
ah, ok, the error I see in chrome is net::ERR_INCOMPLETE_CHUNKED_ENCODING after about ~20MB of downloading
just in case that helps, but sounds like you know about this already!
z
Yeah... It tries to download the entire set of hosts. The new fix implements pagination on the frontend (backend already supported it).
d
the hosts manage page seems to have pagination but I guess it grabs all the results then paginates instead of just grabbing what it needs for page 1.
z
Correct
d
Is it worth pursuing our own fork on this or is the upstream merge fairly imminent?
z
Imminent
d
well, that's great news, thanks!
z
Yeah, I'll be quite pleased to get these changes out! I know lots of folks are struggling with perf issues.
d
is there some timeout that can be trivially increased in the meantime that makes it slow but eventually work?
z
Possibly. I'm not sure where in the stack it would be timing out.
d
I assume some kind of total request time timeout
seems to fail just short of 60s, which seems like a likely timeout value