Small FFT is not a waste of time as a test. It is a waste to use for overall stability testing as you yourself have shown in the above example. Failing large FFTs' at times can be difficult to pinpoint. The possibilities are memory, interaction between the memory and NB or between the CPU and NB.