It is quite common for Memtest to pass where Prime will still fail. Memtest is only the beginning of stability testing, Prime tells the true tale in the end. Unfortunately, it sounds like you have one stick that is much weaker than the other. You may want to try swapping around the sticks in the slots, sometimes placing a weaker stick closer to the CPU can actually assist in it's clocking abilities.