Quote Originally Posted by johnw View Post
One more question. Are you sure you are not re-seeding the random number generator (with the same seed) each time you generate a new file? That would obviously result in repeated data.
Yes, I'm sure

I just checked and it is not being seeded at all during the Endurance test.
(meaning it's using the default seed in the test)

I've been working a lot with this exact problem when creating the SSD Benchmark that's getting close to being ready for beta.
I've been through all the possible phases of buffer/blocksize vs repeating blocks and 7Zip is a pretty good check for this.

I'll do some tests on the files using standard Zip or LZ like alfaunits suggested.
I'm pretty sure the result is that it's being overdone already, I might even remove some of the steps from the loop.