I think the error itself is because we have a 10k(ish) ulimit for open files. We've had to increase this for some other processes too, so I can get past that exact error.