Sure, they don't have to stick with 16 SPs per SIMD. They would have to make fast ROP and Texture Units to keep them from being a bottleneck in this arrangement.

But 2048 shaders? This could have some serious real shader power.