Is there a way to tell OSQuery to only keep X number of INFO/WARNING/ERROR log files or do I need to manage that with something like logrotate?

You need to manage this.