It does have its uses and it has a lot of potential. But a lot of people don't like it because it's too "closed" right now (Nvidia-specific).
Programming for CUDA, I would guess, is kind of a nightmare because it's difficult to parallel across so many cores.
Think about it. There's already so much trouble about several cores... but hundreds?
Bookmarks