I have the same problem. I have a fealing it decreases with higher PCI-E clocks, but it is so random that it is hard to know. Also LOD set to 15 seems to help against these slow downs.