So strange. I just swapped the cards, moved the one that was in the bottom slot to the top and vice versa and now it works great.
Guess that one card just wanted to be on top.

Will post some results after I get everything tuned.