I could see it being useful if the cards had some sort of integrated PhysX CPU that shares the RAM and just works along with the card.

That seems like a solid idea to me, but this... Current implementation just seems flawed. Why not just use your CPU for physics? It has nothing better to do in games these days.