WeeMaan. What tool are you using to remove the pins? It sounds like you're damaging the plastic housing or the pins themselves.

One reason the pins may not stick is because of the amount of heatshrink you might try putting in the housing. That's just something I've noticed a problem, may or may not be yours at all.

What psu are you sleeving?