Using older Linpack library that doesn't utilise AVX is one of the ways.
But you can't really disable it entirely, no.
And it would only affect games if they supported AVX, and none do right now.