Given the downsides, I think the proposed solution as it's now is too hacky to be a net improvement.

"Skip mode_t checks" looks like the only way to go (since I've no idea how to "create temporary dirs" transparently for arbitrary test logic). But skipping tests defeats the purpose of a buildbot, so it's not a solution for the problem at hand.