That's interesting. I do remember seeing a similar result on a different forum. Have you tried at the larger sizes? Like 1 billion?
Another thing is that the AVX binary is indeed tuned for Sandy Bridge, so it's very likely to be sub-optimal on Bulldozer.
Bookmarks