Quote Originally Posted by zerazax View Post
The question isn't how many games... it's what games.

In a relatively small sample size, if you let too many outliers in, you're going to skew data.

IIRC, back when G80/R600 were the cards on the market, people would bench Call of Juarez and say "look, R600 is not as slow!" etc.

Now imagine if a review had 10 games, 3 of which were Call of Juarez esque... instead of the realistic G80 being 30% faster than R600, the average might have dropped to 20%, etc.

If you're going to take an overall comparison, with just 10 games, you'd want all 10 to be as close to neutral as possible.

I mean look at the original big chart... you've got Batman:AA and FarCry 2, well known to favor Nvidia. Aside from the obvious question of how AA was enabled for ATI's cards (again, issues with settings), you have one game accounting for a good chunk of the performance increase. And do you factor in a review like Crysis Warhead 2560x1600 8xAA/16xAF where 17.2/4.7 is going to be "OMGWTF 300% faster!!!" etc.

PR slides at its best
You are making absolutely no sense to me. There are about 15 games in that list and all are popular games which are constantly being used in reviews. Do you think some crucial games were left out in favor of Nvidia-centric titles? I can't see any (except Call of Pripyat). But I do see some titles ATI has been promoting heavily, like Battleforge, Dirt 2 and AvP.

And how is it that we decide which title is "neutral". I don't care if a game is neutral or not, and so shouldn't you. I just look at the importance of the game for me. If you are going to review a card, the games you must use should be popular titles that you know a lot of people would care about. A consumer doesn't and shouldn't care about how the card he is going to buy performs in a "neutral" game, he cares about games he is actually going to play.

I see nothing related to PR in these benchmarks, there are a lot of games including ATI titles, and a lot of settings some of which clearly don't favor Nvidia. If someone was looking for 1680x1050 numbers he shouldn't be buying a GTX 470 or 480 in the first place.