John Lamb
11/15/2023, 11:55 PMStefano Bonicatti
11/16/2023, 10:13 AMJohn Lamb
11/16/2023, 1:13 PMJohn Lamb
11/16/2023, 1:15 PMJohn Lamb
11/16/2023, 2:07 PMStefano Bonicatti
11/16/2023, 2:34 PMtype
and data
columns which can contain every type of event), but a schema has to be a bit more specialized to be immediately useful.
Also, depending on the event type, where possible they ideally have to be augmented with other information that may come from previous events. For instance if you have a fork
event and you want to always see the command line arguments of the process that's forking, you need to keep a cache of that data that you can for instance collect from previous `exec`s, keyed by pid
, so that you can recall it.
Finally each event type might need a slightly different logic to be collected, so all in all we need code to do that, and the event types that are currently present are the ones that have been contributed.
I think definitely osquery would like to have increased visibility.
Back on the topic of being a more generic/vanilla collector, and how event data is presented, there have been some discussions, mostly due to the performance of the current implementation, which often doesn't permit osquery to collect events in high traffic machines. Events have to be stored in an intermediate place so that they can be queried, and they gets processed multiple times, which adds to the overhead.
There's no conclusion yet, and while personally I (and others in the community) think that osquery definitely needs a performance improvement in that area, I'm not officially representing the roadmap. Normally these discussions happen during office hours.Stefano Bonicatti
11/16/2023, 2:43 PMJohn Lamb
11/16/2023, 2:47 PMJohn Lamb
11/16/2023, 2:47 PMJohn Lamb
11/16/2023, 2:47 PMJohn Lamb
11/16/2023, 2:48 PMStefano Bonicatti
11/16/2023, 2:50 PMes_process_events
table.
Also thanks to that cache, I'm augmenting the fork
and exit
events to get the cmdline and count for the process, since currently they were empty. That comes free thanks to the cache.John Lamb
11/16/2023, 2:59 PM