The python integration tests used to test for similar situations. (Different discussion, but on the top of my mind) we should strongly consider restoring those, they protected against many regressions in the past

I think we all want to see those restored, yeah.