Update: the issue still seems to happen below 500FSB. No idea what the issue is.