if you're using the button on the front of your case....did you connect the 2 pin wire to your mobo ? And have you got the 8pin power connector plugged in?

If the PSU comes on by shorting it...and connecting it to the mobo doesnt turn it on, then its got to be one of the above ?

EDIT...unless it's not been wired back correctly ?