I've implemented the option to make a pause after each loop, configurable from no pause up to 30 seconds.

Should I set the default option at 15 seconds just to give the controller some time to breathe (having deleted all the files created during the loop) or should I set it to 0 as in no pause.
(the pause would give the SF controller some time to recover)

All in all what is 10-15 seconds per loop, well, it's up to you , we'd have to agree on this, don't think there are any implications by introducing this option.