Originally Posted by Phase
The global points are not a very good system of scoring. Just show individual hardware rankings like you have been.
Only the top ten scores should count in the overall Team Ranking and only your top scores should count for individual rankings otherwise peeps will just keep submitting scores to increase their points. And those teams with more members like XS will always be on top. It must be a level competition or it becomes arbitrary in the ranking. Giving value according to how many members have submitted scores should not reflect the overall value. What does that have to do with top scores?
If there is not as many submissions then peeps should just download the application and run it, they would have a better chance to get a higher rank than some other benchmarks. The system you have been running is great why change it now? Unless you start over with a new competition it would not be fair and any new teams would not have a chance at all. The points should be awarded for 1st through 10th with a overall weighted score accordingly ie> 10,9,8,7,... points for each place in a different bench with all benchmarks having an equal weight in scoring regardless of how many scores are submitted. Then averaged overall with the top 10 scores of each team. Then you can break it down into hardware specific scoring. Just like you have already done for the last year.
Also in individual rankings it should be the highest score "only" of your top 1st-10th place scores in each benchmark ie>Super Pi 1m,32m,3DM01-06 that reflects your overall ranking, not scores from a year ago that are arbitrary compared to the new top scores. Those older scores should just be used for a lifetime ranking of some kind. Otherwise whats the point? You may as well use an old out of date CPU and become #1 in the world, even though your scores are not even top 1000 of the true world record. Old out of date hardware, should just be a separate competition all together or just a nostalgia competition of some kind. You do not run last years Ferrari at this years F1, right?
Every bench should be scored accordingly for every position you get. The points for that position should be awarded to each team (Or Individual) according to rank.
1st place = 10pts
2nd place = 9pts
3rd place = 8pts
4th place = 7pts
5th place = 6pts
6th place = 5pts
7th place = 4pts
8th place = 3pts
9th place = 2pts
10th place = 1pt
So the current standings would read like this>
XS
Benchmark ranking (current rank - weekly & monthly change in ranking)
* 3Dmark 2001 rank: 1 - - [ list scores ] - [ ranking stats ]
* 3Dmark 2003 rank: 1 - - [ list scores ] - [ ranking stats ]
* 3Dmark 2005 rank: 2 - -1 [ list scores ] - [ ranking stats ]
* 3Dmark 2006 rank: 1 - - [ list scores ] - [ ranking stats ]
* Aquamark rank: 1 - - [ list scores ] - [ ranking stats ]
* CPU-Z rank: 4 +3 +4 [ list scores ] - [ ranking stats ]
* PCMark 2005 rank: 16 -1 -1 [ list scores ] - [ ranking stats ]
* PiFast rank: 8 -1 -2 [ list scores ] - [ ranking stats ]
* SisoftSandra rank: 11 - -1 [ list scores ] - [ ranking stats ]
* SuperPi rank: 1 +1 - [ list scores ] - [ ranking stats ]
* SuperPi 32m rank: 14 - -1
Overall score = 69
OCX
Benchmark ranking (current rank - weekly & monthly change in ranking)
* 3Dmark 2001 rank: 2 - - [ list scores ] - [ ranking stats ]
* 3Dmark 2003 rank: 2 - - [ list scores ] - [ ranking stats ]
* 3Dmark 2005 rank: 1 - +1 [ list scores ] - [ ranking stats ]
* 3Dmark 2006 rank: 3 +2 +1 [ list scores ] - [ ranking stats ]
* Aquamark rank: 7 -1 -3 [ list scores ] - [ ranking stats ]
* CPU-Z rank: 3 +8 +12 [ list scores ] - [ ranking stats ]
* PCMark 2005 rank: 9 +21 +18 [ list scores ] - [ ranking stats ]
* PiFast rank: 21 -1 -2 [ list scores ] - [ ranking stats ]
* SuperPi rank: 2 -1 - [ list scores ] - [ ranking stats ]
* SuperPi 32m rank: 1 - -
Overall score = 68
That is the only fair way to do it.