OK, Intel guys, beat this! :)

Printable View

02-21-2013, 03:42 PM
knopflerbruce

OK, Intel guys, beat this! :)

I got a nice, little 4P board a while ago. After fiddling with it alot, making custom mounts for my heatkiller blocks, dremling some heatsinks, spending $1k on cooling parts alone, I finally got the mofo up and running. Being close to -10c here in the evenings, I decided to push the rig a little bit before installing folding@home and let it do what I got it for: give me some nice points in that ranking.

I'm happy with the results, got closer to the wp1024m overall record than I thought I would using these CPUs, raped the UCBench WR, and finally got the overall Cinebench R11.5 WR as well:)

I didn't push too much for UCBench, wanted to keep the board alive... had roughly 1250-1300w power draw during this run. Maybe I can squeeze another 100MHz out of it... I also knew these chips were efficienct in this benchmark.

http://hwbot.org/submission/2359165_...52.3_mpt_score

Cinebench was just a quick and dirty run. Expected a tad less than I got, but I guess my test run at stock wasn't very effiencient for some reason.

http://hwbot.org/submission/2359161_...6_43.09_points

wPrime1024m was the most difficult one, and the system was pushed pretty much to it's limits. Too bad wprime is very inconsistent on this setup, had to rely on "lucky runs", with no threads lagging behind or console cleaning crap. I think I COULD have beaten the overall record, but the PSU (AX1200) shut down during a run at 4700Mhz and 1.475v, pulling ~1550w according to my wattmeter. A blown up $4k rig... sounds nasty! But everything works OK :)

http://hwbot.org/submission/2359164_...76_30sec_921ms

Thumbs up to SuperMicro for making a server board that can take one hell of a beating, and the AX1200 is a very nice unit as well:) (I wonder if I'm the first to trigger OCP using CPUs "only" on a 1200w unit...)
02-21-2013, 03:44 PM
knopflerbruce

Here are some "work-in-progress"-shots:

http://www.abload.de/img/img_2419eyruc.jpg

http://www.abload.de/img/img_2413qrpg9.jpg

http://www.abload.de/img/img_2396vupte.jpg

http://www.abload.de/img/img_24113rr4c.jpg

http://www.abload.de/img/img_2415dypkx.jpg

http://www.abload.de/img/img_2410knqm0.jpg

http://www.abload.de/img/img_2428lzpz4.jpg

http://www.abload.de/img/img_24354tpw6.jpg

...and finally:

http://www.abload.de/img/img_2438bvrbz.jpg
02-21-2013, 04:07 PM
l0ud_sil3nc3

A truly xtreme setup, awesome work:)
02-21-2013, 04:43 PM
Ivanlabrie

Dayum!

Very nice oc on that quad interlagos setup...impressive :D
02-21-2013, 05:03 PM
M.Beier

Looking ghetto Knut!
Way to go!
02-21-2013, 05:28 PM
knopflerbruce

THanks guys :D I wish I had 4 cpu pots... I'd run a little LN2 on the 2nd mobo and my 4 Magny Cours chips. wp1024m will fall for sure if i try that. I hope the ax1200i can handle the current :p
02-21-2013, 05:41 PM
Ivanlabrie

You're pushing it violently...those i series aren't as tough as seasonic bred stuff. :D
Guess that's xtreme alright? :p
02-21-2013, 05:45 PM
TaPaKaH

you must be one rich student :D
02-21-2013, 05:57 PM
knopflerbruce

Quote:

Originally Posted by TaPaKaH

you must be one rich student :D

I got a part time job next to my studies. Instead of saving those $$$ I spent them on these rigs :p Though I didn't buy much else apart from the parts needed to complete the first build. Still waiting for a couple of parts for the 2nd one. Also not sure if the custom brackets fit, some were ok, some not. if i can get one of the two holes to fit, that'll be enough i think :p
02-22-2013, 12:49 AM
R101

Great job!

How many threads does CB support? I think I might have access to a certain 80-thread Intel machine :).
02-22-2013, 04:46 AM
knopflerbruce

I think it's 64 only :p UCBench has the same limit.
02-22-2013, 12:33 PM
Expat GriZ

Nice one Knut!!! How many pots you need?? :idea: :wasntme:
02-22-2013, 03:28 PM
knopflerbruce

Quote:

Originally Posted by Expat GriZ

Nice one Knut!!! How many pots you need?? :idea: :wasntme:

Send me everything you've got :p
02-22-2013, 05:12 PM
runmc

Very extreme!! Where do you live? North Pole :)
02-22-2013, 06:30 PM
Martin.v.r

no 3Dmark ? nice setup;)
02-22-2013, 07:37 PM
Movieman

:worship::worship::worship::worship::worship::wors hip::worship::worship::worship:
:worship::worship::worship::worship::worship::wors hip::worship::worship::worship:
:worship::worship::worship::worship::worship::wors hip::worship::worship::worship:
:worship::worship::worship::worship::worship::wors hip::worship::worship::worship:
:worship::worship::worship::worship::worship::wors hip::worship::worship::worship:
:worship::worship::worship::worship::worship::wors hip::worship::worship::worship:
Need I say more? :D
02-22-2013, 10:01 PM
chispy

Quote:

Originally Posted by Movieman

:worship::worship::worship::worship::worship::wors hip::worship::worship::worship:
:worship::worship::worship::worship::worship::wors hip::worship::worship::worship:
:worship::worship::worship::worship::worship::wors hip::worship::worship::worship:
:worship::worship::worship::worship::worship::wors hip::worship::worship::worship:
:worship::worship::worship::worship::worship::wors hip::worship::worship::worship:
:worship::worship::worship::worship::worship::wors hip::worship::worship::worship:
Need I say more? :D

:rofl:
02-22-2013, 10:09 PM
Movieman

Quote:

Originally Posted by chispy

:rofl:

I meant that. What I saw him do was something no one has tried before.
This was a big risk, that board and those chips didn't come cheap.
That work to hand make those sinks and waterblocks to make the board able to handle what he wanted was a lot of work
and he did all this with no guarantees.
This to me is the real spirit that we have seen in the past at XS.
People that have an idea and then pursue that idea and make it work.
You have to respect and admire people with that kind of drive.
02-23-2013, 01:28 PM
chispy

Quote:

Originally Posted by Movieman

I meant that. What I saw him do was something no one has tried before.
This was a big risk, that board and those chips didn't come cheap.
That work to hand make those sinks and waterblocks to make the board able to handle what he wanted was a lot of work
and he did all this with no guarantees.
This to me is the real spirit that we have seen in the past at XS.
People that have an idea and then pursue that idea and make it work.
You have to respect and admire people with that kind of drive.

Totally agree with you my good old friend Dave , this reminds me of the good old times here on XS with extreme mods like this , this is trully inspiring work done by Knut , lot of hardwork and money spent to get this set up running ,he accomplish something none has before , well done Knut :up:
02-23-2013, 02:06 PM
knopflerbruce

Love you guys :D <3 <3 <3

I should add that I think I didn't have to add all those sinks between the sockets, as I believe those are for the memory slots, not the CPU (mem voltage is stuck at 1.5v anyway). They're not even close to bein warm. Though, I SHOULD get some sinks for a couple of chips on the back... :p
02-24-2013, 02:42 AM
R101

Quote:

Originally Posted by knopflerbruce

I think it's 64 only :p UCBench has the same limit.

Haha, then I will have to turn off HT and try with only 40.. :)
02-24-2013, 03:04 AM
R101

Quote:

Originally Posted by knopflerbruce

I think it's 64 only :p UCBench has the same limit.

Haha, then I will have to turn off HT and try with only 40.. :)

Or it may support affinity so I could check 40 'real' and 24 HT cores?
02-24-2013, 06:18 AM
[XC] Oj101

Quote:

Originally Posted by chispy

this reminds me of the good old times here on XS with extreme mods like this

Yeah, what happened to those day? :(

Knut, you're bonkers mate :D Mad respect though :up:
02-24-2013, 10:22 AM
schmuckley

That's a lot of part-time job $$ :eek:
02-24-2013, 03:11 PM
knopflerbruce

Yep. Not to mention I got TWO of these setups :p Was running a little wprime 1024m on air using 4x magny cours engineering samples earier today, but looks like I screwed up one of the sockets... only single channel works, so I guess I have to send it to Supermicro for a socket replacement... Good thing it's got no sinks and stuff yet. Got 33.xxx seconds, though... without mounting the coolers, and CPU overheating :p If I had 10L LN2 and 4 pots I'd be sub 30 in no time.
02-24-2013, 03:55 PM
Mafio

awesome stuff there.
keep going. :D
02-25-2013, 03:39 AM
Don_Dan

Crazy project Knut, I like it! :up:
02-25-2013, 02:01 PM
chinook

Your work is an inspiration to us all :up:
02-25-2013, 02:14 PM
sin0822

really nice job there
02-28-2013, 07:48 PM
knopflerbruce

http://hwbot.org/submission/2361730_...he_30sec_108ms - this is on the 2nd board. One dead mem channel and no VRM-sinks... scary :banana::banana::banana::banana:, but pulled only 1000w. Though, overheating alarm started screaming after 5 seconds due to simple air cooling (2x Noctua U9DO's and 2 U12DO's).
02-28-2013, 07:58 PM
Movieman

Quote:

Originally Posted by knopflerbruce

http://hwbot.org/submission/2361730_...he_30sec_108ms - this is on the 2nd board. One dead mem channel and no VRM-sinks... scary :banana::banana::banana::banana:, but pulled only 1000w. Though, overheating alarm started screaming after 5 seconds due to simple air cooling (2x Noctua U9DO's and 2 U12DO's).

You darned well don't leave to much for someone to beat you short of breaking into Intels research lab at 2am..
wait a minute, hmmm, that might be the answer! :idea:
06-17-2014, 11:24 PM
delacroixp

The awesome power of Quad CPU

Great project ... beautiful metal crafting .
Few people really appreciate the raw savagery of parallel processing with 4 CPU's.

One is never enough!

It's all good
:):devil::D
Pascal
06-30-2014, 01:05 AM
FlanK3r

wow, this is true AMD machine :). I want this one unlocked CPU!
06-30-2014, 05:20 PM
lutjens

I find it funny how some folks seem to think that a high core count CPU can't overclock much due to it's many cores. This is proof that the high core count chips from both AMD and Intel are capable of so much more than they are from the factory and can actually overclock quite well. I hope we get to play with unlocked 18-core Xeons this fall and if we do, we should see 4.5GHz overclocks out of it (albeit with considerable power consumption).
07-18-2014, 02:11 AM
knopflerbruce

They do overclock alot worse than regular desktop chips, though. I ran them folding stable at 3.6GHz/1.15v for a long time (hot summer days included), but going higher was difficult - mostly because of the insane power draw (1250W, but peaks at 1300W+, causing my EPS cables to melt...). I have a feeling 4 GHz could be possible, unless something self ignites at 1.4+v :p Need a PAIR of ax1500i's for that project... Some PROPER EPS cables, and I wish I could add one more EPS connector to the board The free "slot" is not for power, someone at SM said when I asked if this was possible.
07-22-2014, 08:14 PM
lutjens

Quote:

Originally Posted by knopflerbruce

They do overclock alot worse than regular desktop chips, though. I ran them folding stable at 3.6GHz/1.15v for a long time (hot summer days included), but going higher was difficult - mostly because of the insane power draw (1250W, but peaks at 1300W+, causing my EPS cables to melt...). I have a feeling 4 GHz could be possible, unless something self ignites at 1.4+v :p Need a PAIR of ax1500i's for that project... Some PROPER EPS cables, and I wish I could add one more EPS connector to the board The free "slot" is not for power, someone at SM said when I asked if this was possible.

As you say, there is a power supply problem. The CPUs themselves seem capable of the higher speeds, but limitations with the power supply itself and with the VRMs on a server board that were never intended to push that much current are the limiting factor. You are running four CPUs...running a dual CPU system shouldn't draw nearly as much power through the EPS cables and this issue should be far less of a concern than with a quad configuration. For those who want to run one high core count CPU on a Rampage V Extreme-caliber board, a highly overclocked 18-core wouldn't be a real problem for the board or it's power delivery system (as long as a decent power supply is used). While the CPU won't break any clock speed records, it should still be able to get with a few hundred MHz of a chip with fewer cores (I'm guessing at around 4GHz for an 18-core CPU while maintaining decent power draw levels and thermals).

My $0.02....;)
07-23-2014, 12:18 PM
knopflerbruce

Quote:

Originally Posted by lutjens

As you say, there is a power supply problem. The CPUs themselves seem capable of the higher speeds, but limitations with the power supply itself and with the VRMs on a server board that were never intended to push that much current are the limiting factor. You are running four CPUs...running a dual CPU system shouldn't draw nearly as much power through the EPS cables and this issue should be far less of a concern than with a quad configuration. For those who want to run one high core count CPU on a Rampage V Extreme-caliber board, a highly overclocked 18-core wouldn't be a real problem for the board or it's power delivery system (as long as a decent power supply is used). While the CPU won't break any clock speed records, it should still be able to get with a few hundred MHz of a chip with fewer cores (I'm guessing at around 4GHz for an 18-core CPU while maintaining decent power draw levels and thermals).

My $0.02....;)

You're sort of right with the EPS argument, however the two SM 1P G34 boards I know of only have a single 8 pin EPS connector. It helps a little bit, but not enough :p When/if there are 2P unlocked xeons on the marked I hope the mobos come with at least 3x EPS connectors, or maybe 2x 8pin EPS + 2x 6/8pin GPU power connectors dedicated to the CPUs. That'll be needed when pushing the limits... 18 cores on RVE will be easy :p 2x 8pin EPS for just one CPU is plenty.
08-10-2014, 08:43 PM
Q56_Monster

Knut that's awesome stuff there. Just ship the board to TiN and let him do some Frankenstein work on it.
10-23-2014, 07:53 AM
Drwho?

"OK, Intel guys, beat this! :)"

Done
http://hwbot.org/submission/2521189_...2_58.41_points

Nice going tho! 34% faster, no OC
10-23-2014, 08:34 AM
Movieman

Quote:

Originally Posted by Drwho?

"OK, Intel guys, beat this! :)"

Done
http://hwbot.org/submission/2521189_...2_58.41_points

Nice going tho! 34% faster, no OC

Actually this is the HWBot record I'll be going after this weekend! :D
http://hwbot.org/submission/2641470_...3_46.37_points
10-23-2014, 12:19 PM
FlanK3r

I like this picture, seems as enthusiast "home PC" :)
http://hwbot.org/image/1258449.jpg
10-23-2014, 01:35 PM
Charles Wirth

/pulls up a chair

http://decorativesoul.com/wp-content...de4e6b5071.jpg
11-04-2014, 04:35 PM
knopflerbruce

Took a while, but... well done :p