Title
#kolide
b

BJF

05/11/2020, 1:09 PM
Hello! I have a general sizing question regarding Kolide Fleet: what is the approximate maximum number of osquery clients that can connect to a single Kolide Fleet instance? Also, what sort of system requirements are recommended for a server running Kolide Fleet together with Redis and MySQL (CPU, memory, storage, etc.). I have been finding it difficult to locate any online documentation regarding such requirements. Thanks!
zwass

zwass

05/11/2020, 3:16 PM
20-30k in an instance currently. There are some changes coming very soon that will 10x that. How many are you aiming for?
b

BJF

05/11/2020, 3:22 PM
Initially ~30,000, but eventually ~250,000.
3:23 PM
We are willing to have multiple Fleet servers with a common Redis/MySQL backend, if necessary.
3:24 PM
For a Fleet server connecting to ~30,000 nodes, what would be sensible specifications regarding memory/cpu/disk space?
3:25 PM
Also, any recommendations for a Redis/MySQL backend server connecting to up to 10 such Fleet servers?
3:27 PM
Regarding the forthcoming capacity enhancements, is there any time schedule for their arrival? Thanks!
zwass

zwass

05/11/2020, 3:43 PM
Capacity enhancements likely to come in the next few weeks. Your MySQL server will be taking on most of the load, so that's the one that should have the strongest stats. Plus it's easy to add additional Fleet servers connecting to the same MySQL. All of this highly varies based on your intervals, query volume, etc.
b

BJF

05/11/2020, 3:45 PM
Are there any good starting recommendations?
3:47 PM
Recommendations on the high side are acceptable to us since growth is expected - better to be oversized than undersized.
zwass

zwass

05/11/2020, 4:33 PM
Say
db.m4.10xlarge
from AWS or equivalent for MySQL. 2 medium sized EC2 boxes should do fine for Fleet. 1 smallish Redis.
b

BJF

05/11/2020, 4:35 PM
Thanks! This is very helpful.
5:52 PM
For clarification: by medium EC2 do you mean someting like m5.2xlarge? For smallish EC2, m5.large? Thanks!
zwass

zwass

05/11/2020, 5:55 PM
Yes those sound good.
b

BJF

05/11/2020, 5:55 PM
Thank! This gives me some specification with which to begin.