Countdown to HCC Completion Thread!

[Johnmark]

My points were much lower this morning than usual when I checked this morning. I hope they fix the validation issue soon.

They did something !
From BOINC Stats just a few minutes ago.

107,203,147.03
Comprising 106,250,228.34 from the daily update
+ 952,918.69 since then

I've got 1100 pages of work in the que and 450 pages left pending validation.

anubis, 5.4 T flops, that's crazy hey! I can recall when super computing was aiming for 1 Tflop!
The timing for ending of HCC worked well for me, as I'm seriously thinking of semi-retirement this year as well. Enough shift work for this man!! Anyone have a rental house in a warm climate, so that I can escape Alberta winters ?

[nanoprobe]

Perfect timing. WCG HCC GPU is winding down and one of my cards is crapping out. RMA #3. What a PITA. Hope I can finish what's in cache before it totally quits.

[Moo]

I am getting some new gpu wu's.

5/2/2013 5:34:23 PM | World Community Grid | Finished download of M0000002670067201008191107_M0000002670067201008191 107.zip

[OldChap]

4 new tasks about 4 hours ago so must be at the bottom of the barrel now. <2400 wu's in cache now so I guess this weekend is rig dust removal time

[Mumak]

Today I got about 200 resends.
I think on Tuesday/Wednesday there might be more resends when users buffered too much work are going to time-out...

[Otis11]

7950 is out of units. I'll have to switch over to CEP2 when I get home from work. Anyone know how 8 threads of CEP2 will run on a single machine (Home-PC in sig)?

7770 has 545 tasks left, about 18 hours. I'll be switching it over to CEP2 as well until I get my Sapphire.

I sure hope you have a SSD - preferably in RAID. Otherwise your HDD will limit your CPU and you won't get 8 days/day of work anyway.

[Otis11]

Only one machine is out of w.u's. A couple 7770's are still working on 0/1 wu's with a projected end date of 05/08 so there should be some re-sends until then.

A special Thank You to those that have crunched HCC, I appreciate all your efforts.

As for me, after over three 3 years of extreme crunching it's time to turn off the PSU's and turn the household decor back over to the wife.

P.S. If you live in Alberta and are looking for a cruncher or just a good machine please PM me as I'll be selling. However I won't be shipping anything as all my crunchers are going to be sold as a full system, cases and all.

Does this mean you're not coming back when HCC2 resumes? You will be missed my friend - hope you stick around even if you don't crunch as much. As many have said, you've done more than your fair share!

[bluestang]

I sure hope you have a SSD - preferably in RAID. Otherwise your HDD will limit your CPU and you won't get 8 days/day of work anyway.

SSD....yes.
RAID...No, just ditched 2x64GB M4's in R0 for a single 128GB V4 (I need more ports).
Is the BOINC Data folder stored on the SSD...no.

[[XC] Oj101]

Why not? I can't imagine a hard drive will keep up with more than two or three CEP2 WUs.

[Evantaur]

Why not? I can't imagine a hard drive will keep up with more than two or three CEP2 WUs.

ram disk

[nanoprobe]

Why not? I can't imagine a hard drive will keep up with more than two or three CEP2 WUs.

It can keep up with 8 on Linux if you set the Task checkpoint to disk at most every xxx seconds to 300 from the default 60 under the Disk and memory usage tab in BoincManager. I believe Windows will also run 8 but you may want to run 4 to start and work your way up. The finished files to upload are also very large so make sure you have enough bandwith.

[BlindShot]

ram disk

They work very good. My As ssd score was 19776 using a ram disk. seq 5233.22 mbs read and 5258.18 mbs write.

[Gandalf]

ram disk

You have peaked my interest, Evantaur. I queried once about using RAM for crunching vice Disk space (it would obviously be faster), but was told it was not possible.
Yesterday, I ordered 24GB of RAM from Crucial.com to improved my computers crunching performance. I must be getting psychic.
Can you provide me with a URL as to how to set this up in a Win7 environment and what specifically do I need to do in the Boinc Manager?

Thanks

[OldChap]

If any of you you want to run a Linux Ram Disk setup I will find the link for the how to.

To do this with CEP2 might need a shed load of ram mind...I seem to recall that there is a 1Gig ram and a 2 Gig HDD/ssd requirement per thread running

Such a write intensive project sounds like a job for Samsung 830, 840pro or Intel 520 to me

[yojimbo197]

If any of you you want to run a Linux Ram Disk setup I will find the link for the how to.

To do this with CEP2 might need a shed load of ram mind...I seem to recall that there is a 1Gig ram and a 2 Gig HDD/ssd requirement per thread running

Such a write intensive project sounds like a job for Samsung 830, 840pro or Intel 520 to me

I might be interested in the link for a Linux RAM disk setup.

[OldChap]

Have fun> I will be playing with this soon too.

https://secure.worldcommunitygrid.or...d?thread=32683

[vitchilo]

Is it possible run normal wcg on just ram?

[D_A]

Is it possible run normal wcg on just ram?

If you mean run BOINC in a RAM drive then yes. You have to set up scripts to copy the RAM drive into physical storage at shut down and back into the RAM drive at boot before the BOINC service is started, but it's quite possible. CEP2 is the only project that would really benefit from it though (CEP2 is heavily affected by disk IO speed due to the amount of data it writes to disk) and you'll need a lot of installed RAM to make it worth doing.

[Gandalf]

If you mean run BOINC in a RAM drive then yes. You have to set up scripts to copy the RAM drive into physical storage at shut down and back into the RAM drive at boot before the BOINC service is started, but it's quite possible. CEP2 is the only project that would really benefit from it though (CEP2 is heavily affected by disk IO speed due to the amount of data it writes to disk) and you'll need a lot of installed RAM to make it worth doing.

D_A - Do you need to reinstall the BOINC software into the RAMDRIVE? I'm running Win7.

Is 20GB considered a lot of RAM for this purpose?

[BlindFreddie]

If any of you you want to run a Linux Ram Disk setup I will find the link for the how to.

Re RAMdisks for WCG: See also http://www.worldcommunitygrid.org/fo...30244_offset,0
It's a long thread. Haven't trawled thru it looking for conclusions on whether a RAMdisk helped all that much to run many simultaneous CEP2 WUs, but I suspect results may not have been as good as expected.

Except when CEP2 WUs are starting up, where they create thousands of little files, HDD activity does not seem to be super-high anyway. Remember that the O/S runs a disk cache sytem in RAM, and there's also the cache onboard modern HDDs. I think the problems with running multiple CEP2 WUs may be because CEP2 makes too many system calls to the O/S, doing little accesses to myriads of files, and also producing heaps and heaps of pagefaults. A lot of the file I/O data would be handled by the caches, so a slow underlying storage medium may not matter too much. The speed problem may arise because the O/S may have to handle the datafile and pagefile activity in single-threaded mode in order to synchronise things; it handles 2-3 CEP2 WUs OK, but much above that the file I/O thread gets saturated - a software limitation rather than a hardware one.

I could be wrong tho.

I don't want to run a large number of CEP2 threads anyway. For various reasons, organic solar cells are not going to solve the world's energy problems, though I think it's worthwhile research and the project is short of crunching power. I'm crunching FAAH and GFAM, with 3 CEP2s on each of my machines that are capable of it.
You might consider contributing to some of the other WCG projects too.

[Back on topic]:
C:\BOINC_Data\projects\www.worldcommunitygrid.org> time
The current time is: 16:40:54.23
C:\BOINC_Data\projects\www.worldcommunitygrid.org> date
The current date is: Sat 04/05/2013
C:\BOINC_Data\projects\www.worldcommunitygrid.org> ls [XM][0-9][0-9]*.zip | wc -l
3909

i.e. still have 3900 HCC WUs on my GPU machine
BTW the "ls" and "wc" are freeware from http://www.rtr.com/Ready-to-Run_Soft...s_readypak.htm. My thanks to Ready-to-Run Software.

[0ne.shot]

I'm still at about 3500 WUs in my cache.

[anubis]

CEP2 does about 32GiB reads and writes per WU.

SSD is not such a good idea if you have 8+ of them running.

[Mumak]

Strange, but today I got some new (not resend) WUs like:

Project Name: Help Conquer Cancer
Created: 05/04/2013 10:46:47
Name: X0960077261247200610191228

How's that possible?

[BlindShot]

Strange, but today a got some new (not resend) WUs like:


How's that possible?

So did I. The thing that has me scratching my head is running cpu w/u on top of hcc and still keeping up with my gpu. Learning how to make the most of my system while running hcc gpu has been a learning experience for sure.

[Rob_B]

Same here. Got around 25 new wu's.

I'm curious how much difference the end of HCC1 will make for the other projects. In our team it will be a big difference, but how will it be for the total on WCG? The other projects should see a nice increase.

I know it makes a difference for me. On 2 crunchers the total power dropped with around 110 watts.