New Multi-Threaded Pi Program - Faster than SuperPi and PiFast

[poke349]

hey poke, looks like your package is scheduladed to be there on wed. hope you enjoy it...

you will see when you get it that the power demands are a bit big. you need 5 power connectors for it to run. you need 1 24pin atx, 1 4pin molex, 2-8pin power, and 1-4pin power as well. the easiest way i found to hook it up was for one of the 8 pin, to use a 4 to 8 pin adapter, ive sent one with it. its been running at 100% load for the last 14 months like that with no problems now for the last 4 pin, use a pic-e and hook it up backwards. if you need a better explination, call me and ill talk you through it. but what you do is take the pci-e and go to hook it up normaly where the latch on it hooks on the board, flip it around so the latch is on the other side 180 degrees, and let the first pair of connectors hang over the side of the mobo, and give it a little pressure it will fit in nicely. to make sure its right, look at the 2 8pins and where the yellow pos12v is the pcie should have its 12pos on the same side .

Thanks! It's gonna be a very valuable development rig since it'll be the first NUMA machine I ever get. It'll definitely be put to good use.


Woah... that's a big PSU requirement.

I just took a closer look at my 1000W Corsair. It has:

• 1 x 8-pin connector - which can split into 2 x 4-pins
• 1 x modular 8-pin connector - which can also split into 2 x 4-pins
• 2 x 3/4-pin PCIe
• enough modular PCIes to run 4-way SLI...

So I think it should work without using a PCIe. I can split one of the 8-pin connectors. Run one into the 4-pin on the board and hook up the 4 to 8-pin adapter to the other...

The PSU I have in my Harpertown rig has 2 x 8-pin + a 4-pin "ram power connector". (advertised as being able to handle fully-loaded quad-sockets with fully loaded ram configurations )
So in the worst case, I can swap PSUs with that rig.

This 1000W Corsair was originally for my Harpertown rig - and it seems to run it with no issues.
But 16 high-capacity FB-DIMM ram modules pull 4.5A on the +5Vsb rail. That 1000W Corsair is only rated for 3.5A on that rail. So I ended up getting an even stronger PSU for that rig.
But I suppose they overbuild these PSUs anyway... I'll see when it arrives.

[sy5tem2]

hello!

here is my little result .

100M

Validation Version:    1.1

Program:               y-cruncher - Gamma to the eXtReMe!!!     ( www.numberworld.org )
                       Copyright 2008-2011 Alexander J. Yee    ( a-yee@northwestern.edu )


User:                  Carl Nepveu


Processor(s):          Intel(R) Core(TM)2 Quad CPU Q9400 @ 2.66GHz
Logical Cores:         4
Physical Memory:       4,293,963,776 bytes  ( 4.00 GB )
CPU Frequency:         3,600,057,472 Hz

Program Version:       0.5.5 Build 9178 Alpha (x64 SSE4.1 - Windows ~ Nagisa)
Constant:              Pi
Algorithm:             Chudnovsky Formula
Decimal Digits:        100,000,000
Hexadecimal Digits:    Disabled
Threading Mode:        4 threads
Computation Mode:      Ram Only
Swap Disks:            0
Working Memory:        536 MB

Start Date:            Mon Feb 07 23:34:57 2011
End Date:              Mon Feb 07 23:35:48 2011

Computation Time:      48.579 seconds
Total Time:            51.071 seconds

CPU Utilization:           368.29 %
Multi-core Efficiency:     92.07 %

Last Digits:
9948682556 3967530560 3352869667 7734610718 4471868529  :  99,999,950
7572203175 2074898161 1683139375 1497058112 0187751592  :  100,000,000

Timer Sanity Check:        Passed
Frequency Sanity Check:    Passed
ECC Recovered Errors:      0
Checkpoint From:           None

----

Checksum:   a1b698af844046320e5be1d9efc2010f0e436a93392fbd9d18a1189011148184

500M

Validation Version:    1.1

Program:               y-cruncher - Gamma to the eXtReMe!!!     ( www.numberworld.org )
                       Copyright 2008-2011 Alexander J. Yee    ( a-yee@northwestern.edu )


User:                  None Specified - You can edit this in "Username.txt".


Processor(s):          Intel(R) Core(TM)2 Quad CPU Q9400 @ 2.66GHz
Logical Cores:         4
Physical Memory:       4,293,963,776 bytes  ( 4.00 GB )
CPU Frequency:         3,600,051,840 Hz

Program Version:       0.5.5 Build 9178 Alpha (x64 SSE4.1 - Windows ~ Nagisa)
Constant:              Pi
Algorithm:             Chudnovsky Formula
Decimal Digits:        500,000,000
Hexadecimal Digits:    Disabled
Threading Mode:        4 threads
Computation Mode:      Ram Only
Swap Disks:            0
Working Memory:        2.42 GB

Start Date:            Mon Feb 07 23:11:53 2011
End Date:              Mon Feb 07 23:17:18 2011

Computation Time:      312.729 seconds
Total Time:            325.474 seconds

CPU Utilization:           376.13 %
Multi-core Efficiency:     94.03 %

Last Digits:
3896531789 0364496761 5664275325 5483742003 7847987772  :  499,999,950
5002477883 0364214864 5906800532 7052368734 3293261427  :  500,000,000

Timer Sanity Check:        Passed
Frequency Sanity Check:    Passed
ECC Recovered Errors:      0
Checkpoint From:           None

----

Checksum:   8743fd538af6ad5e08eb772e4bb4cb4b39c8e2d6604b16560be1d569747931aa

ty

have a nice day

[skycrane]

Thanks! It's gonna be a very valuable development rig since it'll be the first NUMA machine I ever get. It'll definitely be put to good use.


Woah... that's a big PSU requirement.

I just took a closer look at my 1000W Corsair. It has:

• 1 x 8-pin connector - which can split into 2 x 4-pins
• 1 x modular 8-pin connector - which can also split into 2 x 4-pins
• 2 x 3/4-pin PCIe
• enough modular PCIes to run 4-way SLI...

So I think it should work without using a PCIe. I can split one of the 8-pin connectors. Run one into the 4-pin on the board and hook up the 4 to 8-pin adapter to the other...

The PSU I have in my Harpertown rig has 2 x 8-pin + a 4-pin "ram power connector". (advertised as being able to handle fully-loaded quad-sockets with fully loaded ram configurations )
So in the worst case, I can swap PSUs with that rig.

This 1000W Corsair was originally for my Harpertown rig - and it seems to run it with no issues.
But 16 high-capacity FB-DIMM ram modules pull 4.5A on the +5Vsb rail. That 1000W Corsair is only rated for 3.5A on that rail. So I ended up getting an even stronger PSU for that rig.
But I suppose they overbuild these PSUs anyway... I'll see when it arrives.

yea that should work i had it running for 13 months with a old small PC&C 500w running full load for that long without a problem.... so i think 1kw will be ok...

when you get it, can you keep the white box, and the foam insert for when you send it back.

you should have the board, 4 optis, 8gb ram, hdd with server03 installed, booklet, cd-rom, and 4 hsf. the hsf might be a bit loud i cut the blue wire to have them run 100% to keep my temps at a nice 15c

the only thing i ask, is that when ur done testing for the day, just to let boinc run the eon project.

skycrane

[poke349]

yea that should work i had it running for 13 months with a old small PC&C 500w running full load for that long without a problem.... so i think 1kw will be ok...

when you get it, can you keep the white box, and the foam insert for when you send it back.

you should have the board, 4 optis, 8gb ram, hdd with server03 installed, booklet, cd-rom, and 4 hsf. the hsf might be a bit loud i cut the blue wire to have them run 100% to keep my temps at a nice 15c

the only thing i ask, is that when ur done testing for the day, just to let boinc run the eon project.

skycrane

Will definitely keep the packaging. (If it's absurdly big, then I might have flatten it to put behind my bed or something...)

I just created a WCG account (Mysticial) and put it on the XS team.
But I can't find the eon project on the lists, so I have it running something else right now.

I've got one machine on it for now. (A Core i7 860 @ stock) I might put my i7 920 rig on it later, but I'll need to re-tune the OC since it does get a little hot under load.
Same applies to my SB rig - I have it at 1.4v for 24/7 - not sure if I'm willing to sustain it under load.

One thing is, I can't put my Harpertown rig on WCG. It's too loud to keep on 24/7 and probably isn't worth the power consumption with the overkill amount of ram it has.
Even though it's at stock, it has burned out 3 times in the past (even from idling... ) And everything is past warranty.

[skycrane]

what burnt out on it? the board? or the ram?
wait a min, thats 8-8gb sticks of fbdimm.... holly crap man i hope you got a really great deal on that
have you re-re-read the manual? all the servers i have are very picky on connection all the power connectors to the board. you might have missed a small fdd somewhere that gives extra 5v to the ram.

[poke349]

what burnt out on it? the board? or the ram?
wait a min, thats 8-8gb sticks of fbdimm.... holly crap man i hope you got a really great deal on that
have you re-re-read the manual? all the servers i have are very picky on connection all the power connectors to the board. you might have missed a small fdd somewhere that gives extra 5v to the ram.

Tyan Tempest S5397... It was designed during the early Clovertown days and then recertified for the Harpertowns. Which is probably why.
The highest-end Clovertown at the time pulled 95W. I have a pair of 150W Harpertowns on it with another 200W of ram...

The first time it burned it, it was a mosfet on socket 0.
Second time it died it had something to do with the NB.
Third time it died, it had something to do with the memory controller...

Mobo every single time... And I'm sure nothing was overheating either.

Even with my ridiculous cooling setup, it only delayed those later two inevitable RMAs.
I've stopped putting the machine under 24/7 stress for about a year and a half now. I decided it wasn't worth it and moved all my low-memory computation work to my cheaper single-socket machines.
It's under a new mobo now - SuperMicro MBD-X7DWN+O. But its still gonna stay off most of the time. I only use it for things that will not run on my other machines - precisely anything that needs memory.

p.s. The rig has 16 x 4GB not 8 x 8GB. It had a very special purpose when I first built it a few years ago, but now it's just another one of my coding workstations...

EDIT:
I went through 3 PSUs before settling on one that I liked.
750W Silencer - No Post
1000W Corsair - Works, but +5Vsb rail wasn't strong enough.
1000W Enermax - Works, and is advertised for quad-SLI/quad-fire/quad-socket/32-DIMMs...

The 750W Silencer ended up going in my i7 920 rig. The 1000W Corsair became my open-air tester and will go in the rig you're sending me.

[alpha754293]

Couple of things - a)

@poke
GPU might still be helpful if it's computationally bound. While yes, if you're memory bound, you probably won't be able to load the entire problem into the GPU RAM, and I would think that swapping to the CPU RAM MAY be possible, but costly. But it would probably still likely be faster than trying to run the whole thing on CPU. A speedup is a speedup is a speedup. I wouldn't know anything about it because I've been pulled off the analysis side of things at work. (Boo hoo... :o() Otherwise, the next thing that I would have been asking for is a Fermi card for my system and take 4 hour FEA and run it in like 15 minutes on the card. But...that doesn't matter. And I still can't justify spending $4k on a card myself for "home" use. (If I could run my CFD on it, that'd be a different story).

b) @skycrane/poke
That's quite the power demands. What kind of board it is? Actually, I've heard about quite a number of the Tyan Intel boards failing at work too. I don't know what happens to them. My Opteron Tyan boards have all been very stable/solid.

Even with our latest quad Socket G34 board, it only takes I think 1x 24pin, and 3x 8pin for the power. And after a little snafu with improperly load balancing the PSU, causing it to trip the overcurrent protection -- it's fine now that it's rebalanced, and running on a Corsair 1kW PSU. So I can't imagine why that system would have that crazy power supply requirements.

The only system that I've got now that's too loud to run 24/7 is my Sun Fire X4200 (dual Opteron 2.8 GHz, single core, 8 GB of RAM, 4x 73 GB 10krpm 2.5" Fujitsu SAS drives, quad GbE + one 10/100 dedicated BMC/SNMP/IPMI/GRASP management NIC). That thing gives me a headache. Everything else, I can pretty much 24/7.

[skycrane]

hmmmm i see something just got delivered.......

[poke349]

hmmmm i see something just got delivered.......

Yep It's in my room sitting on a static mat right now. Then I realized I had class.

It looks preeeettttty slick! Then I realized it's not gonna fit in my CM HAF 932. I'm not sure if it will fit even if I cut out the upper PSU mounts that are blocking it.

[poke349]

Okay... I see what you mean by loud.

That's louder than my Harpertown rig (and high pitch). And even louder than my i7 920 rig when I turn the Deltas up to max for suicide OCs.

So I'm not gonna be able to sleep with it on.
I also don't think I can put it in my office either, everyone will disembowel me .

To run it 24/7, I'm gonna need to find a way to speed control them.
I don't see anything in the BIOS that doesn't rely on the blue-line, so I'll probably grab one of these off the egg:
http://www.newegg.com/Product/Produc...-065-_-Product

I'll probably grab another 4 x 2GB set of ram to put everything in dual-channel.


(click to enlarge)


Anyways, I'm gonna try to mount it in my CM HAF 932. I've bent the PSU mounts out of the way and pulled the top fan out. So I think it should work.

[skycrane]

poke, it looks great, hope your able to make it fit in the case.

you can hook the blue wires back up, just strip the ends off and a little bit of black tape and twist them together should work, without you having to get the speed controller

im sorry about that, i should have fixed them before i sent them out.

[poke349]

poke, it looks great, hope your able to make it fit in the case.

you can hook the blue wires back up, just strip the ends off and a little bit of black tape and twist them together should work, without you having to get the speed controller

im sorry about that, i should have fixed them before i sent them out.

I was thinking along the lines of bringing them into a soldering room to do that, but it might be overkill .

The temps barely hit 35 - 39C under prime with 74F ambient. (3 of them are at 32 - 35, one is at 39 so I'll probably try reseating that last one.)
Either way, I'm thinking that's pretty far below the safe 24/7 limit.


It fits! Barely... 3mm taller and the case fans at the top will hit the ram modules. Half an inch taller and it hits the very top of the case.
Since there are no mounting holes up there, I had to stack standoffs to keep the mobo above the tray. So it isn't screwed down up there, but at least it won't touch the mobo tray.
(I did the same with the new EEATX mobo in my Harpertown rig in a CM Cosmos case.)

(click to enlarge)




Just wondering, were you running these boards open-air? I see no scratches on any of the mounting holes.

Oh and the I/O panel just happens to be compatible with that of my old Tyan S5397... lolz

[skycrane]

yea they were all run in open air, all sitting on a piece of plywood, with small standoffs screwed into the bottom of the cpu mounting plates thats amazing that the I/O panel fits.

that is one tight fit in there. how is the HDD i sent working, no problems getting server03 to work?

[poke349]

yea they were all run in open air, all sitting on a piece of plywood, with small standoffs screwed into the bottom of the cpu mounting plates thats amazing that the I/O panel fits.

that is one tight fit in there. how is the HDD i sent working, no problems getting server03 to work?

Ah... see, I'm in a dorm. So I don't have that much surface area.
Prior to the one you just sent, I had 5 machines in my tiny dorm - 4 of which stay on 24/7. And I'm already taking advantage of that 3rd dimension - up .

I have my i7 920 on WCG. My SB rig will follow once I finish a few things.
I'm gonna try to setup the quad you sent me on Linux WCG since I need it as an SSH server with my group-mates for a NUMA project we're doing.
(I'm gonna put another drive in there for Linux.)

As for the ones I'll keep off WCG:
My laptop idles at 60C. My Harpertown rig is too fragile and too loud to stay on 24/7, and my file server is a Prescott...


Yep, Server 2003 works fine. I think there's gonna be a few drivers I need update. I'll see.

[Alpha]

wow.... Looks nice poke and skycrane! wanna give it a run on multi-prime? (link in sig).

also, that could be a mean gaming rig with that 9800gtx, lol

[poke349]

wow.... Looks nice poke and skycrane! wanna give it a run on multi-prime? (link in sig).

also, that could be a mean gaming rig with that 9800gtx, lol

Will do. But next week though. I can't use the rig until I get fan control and mosfet cooling setup.

Meh... That's just a leftovered and unused card I had sitting around. It sucks for games since it's so old, so all it's good for now is to get full resolution. (Which is definitely helpful for coding... )


Charts Updated!

[skycrane]

alpha herre are my times
16 - 2.032
32 - 5.625
64 -15.5
128-42.797
256-118.375
512-327.532
1b - 876.156

you dont have a win 64bit?

these are all on my quad socket quad core opti 8356@ 2.32ghz 16 true cores

hey poke, its been 2 days and no update !!!!!!

[poke349]

alpha herre are my times
16 - 2.032
32 - 5.625
64 -15.5
128-42.797
256-118.375
512-327.532
1b - 876.156

you dont have a win 64bit?

these are all on my quad socket quad core opti 8356@ 2.32ghz 16 true cores

hey poke, its been 2 days and no update !!!!!!

I haven't gotten the fans fixed yet. Don't have the tools to do it here. (or the time to do it)
I also don't have enough spare small fans to put on the mosfets, nor do I have a spare optical drive.
My newegg order is coming on Tuesday so I'll have everything I need by then.

So I've been tuning my SB rig for WCG in the meantime. I just put it on yesterday, so I won't know how much it generates until the point system stabilizes in a couple days.


Also, when I shrank the partition on the drive you sent me to make room for Linux, it somehow broke the activation on the machine.
I did make a ghost copy of the drive before I did that. But now I'm debating whether to reload the ghost copy, or just install server 2008.

Any idea how many WCG points I can expect from this thing? (can't wait to get it up and running)

[alpha754293]

@poke/skycrane

What are the specs of the system?

[poke349]

@poke/skycrane

What are the specs of the system?

4 x Opteron 8356 @ 2.3 GHz
Not sure how much ram he's running.

The one skycrane sent me is the same, but with 8GB.
I should have it up and running 24/7 on Tuesday when my newegg order of fans and fan controllers come in.

[poke349]

Alright, the thing is good to go for 24/7. It's quieter than the AC and the load temps are all good. The mosfet sinks are cold to touch under load - same with the south bridges...

(click to enlarge)



Gonna put it on WCG for a few days to see what it gets before I switch it over to Linux for some real NUMA programming!

[skycrane]

alpha, i had 3 systems all the same, tyan s4985 mobo, 4 8356 optis@2.31ghz, 2 with 8gb of ddr2-4300ecc, and one with 16gb.

i gave one to poke, so he can get the NUMA working for his pi program

hey poke, it looks good, glad to see its up and running. do you think there are enough fan connnectors on the mobo i think there are 10 of them hehe

[poke349]

alpha, i had 3 systems all the same, tyan s4985 mobo, 4 8356 optis@2.31ghz, 2 with 8gb of ddr2-4300ecc, and one with 16gb.

i gave one to poke, so he can get the NUMA working for his pi program

hey poke, it looks good, glad to see its up and running. do you think there are enough fan connnectors on the mobo i think there are 10 of them hehe

The pi program is a small thing. It's more about learning how to program for NUMA. That's more important.

There's definitely enough fan connectors on the mobo... I haven't used all of them yet.

Just wondering... what's the ram rated for in terms of heat? There's no temperature sensor on them but my heat gun is showing 52 - 55C under load. I'm not sure if that's too hot (and those numbers are just the top of the ICs, not sure about inside...) The FB-DIMMs in my Harpertown rig will hit 70 - 75C, but they are rated for 105C so I'm not concerned about them. But we're talking normal ECC ram here...


EDIT:
@ Alpha
You still want me to run the benchmark? Skycrane already ran it and like he said, the machine is identical.

[poke349]

Here, I ran it on my other two machines:

I didn't feel like rebooting my Sandy Bridge rig to clock it up. So it's only at 4.4 GHz.

Is there a reason why this thing runs so well on my Harpertown rig? It absolutely destroyed my SB rig.
Even if you cut in a factor of two for having two sockets, my Harpertown rig still beats the SB rig in clock-for-clock efficiency?

(click to enlarge)


(click to enlarge)

[Alpha]

it doesnt like HT very much at all for some reason. Now that i have a toy to play with, i can see if i can work something out - lost all my original code though a few years back...

my 9775's destroy this benchmark as well compared to my i7. not sure why...

Here's to learning!