https://github.com/osquery/osquery logo
Title
d

Daniel Parry

06/29/2020, 11:10 PM
Having added >10k hosts to kolide fleet the hosts/manage page often pops up with "It's Kinda Lonely In Here..." when it seems to timeout fetching host information. Is this a known limitation with the web UI or is there something that can be tuned to improve page load speed? The call that seems to be really slow is to api/v1/kolide/hosts. Any thoughts please?
z

zwass

06/29/2020, 11:10 PM
Yeah, it's a well-known problem. I have a fix for it that I worked on with a client and trying to get through the final steps to contributing those back upstream.
d

Daniel Parry

06/29/2020, 11:29 PM
ah, ok, the error I see in chrome is net::ERR_INCOMPLETE_CHUNKED_ENCODING after about ~20MB of downloading
just in case that helps, but sounds like you know about this already!
z

zwass

06/29/2020, 11:40 PM
Yeah... It tries to download the entire set of hosts. The new fix implements pagination on the frontend (backend already supported it).
d

Daniel Parry

06/29/2020, 11:48 PM
the hosts manage page seems to have pagination but I guess it grabs all the results then paginates instead of just grabbing what it needs for page 1.
z

zwass

06/29/2020, 11:48 PM
Correct
d

Daniel Parry

06/29/2020, 11:49 PM
Is it worth pursuing our own fork on this or is the upstream merge fairly imminent?
z

zwass

06/29/2020, 11:49 PM
Imminent
d

Daniel Parry

06/29/2020, 11:49 PM
well, that's great news, thanks!
z

zwass

06/29/2020, 11:55 PM
Yeah, I'll be quite pleased to get these changes out! I know lots of folks are struggling with perf issues.
d

Daniel Parry

06/30/2020, 12:15 AM
is there some timeout that can be trivially increased in the meantime that makes it slow but eventually work?
z

zwass

06/30/2020, 12:17 AM
Possibly. I'm not sure where in the stack it would be timing out.
d

Daniel Parry

06/30/2020, 12:17 AM
I assume some kind of total request time timeout
seems to fail just short of 60s, which seems like a likely timeout value