For right price, yes 512MB is enough. I got 1GB's , because found them cheaper than 512MB.
Get yourself right memory: DDR2 PC2-5300 667 Registered ECC.