Yes, I'm alive! Just thrashing my pfsense box around a little bit to see what it can handle, and MJ12 is perfect for that cause.
It's acting up with my proxy though, I might have to disable logging. A few million URLs a day adds up in the logs rather quickly...
Time for some new hardware, this poor Atom has trouble keeping up with two MJ12 clients, saturating only 30% of my available bandwidth:
Last edited by Martijn; 04-20-2012 at 04:14 PM.
Main rig:
CPU: I7 920C0 @ 3.6Ghz (180*20)
Mobo: DFI UT X58 T3eH8
RAM: 12GB OCZ DDR3-1600 Platinum
GPU/LCD: GeForce GTX280 + GeForce 8600GTS (Quad LCDs)
Intel X25-M G2 80GB, 12TB storage
PSU/Case: Corsair AX850, Silverstone TJ07
Nice Martijn!pfSense is a great piece of software
BIG team milestone coming up!
that's 2 Petabytes!!!!Code:Name: XtremeSystems URLs crawled: 79,039,277,264 Data (MB): 2,002,147,406
That IS quite a few hard drives worth
Hope this dire 2 months of buckets gets finished soon though
My Biggest Fear Is When I die, My Wife Sells All My Stuff For What I Told Her I Paid For It.79 SB threads and 32 IB Threads across 4 rigs 111 threads Crunching!!
hear hear!Originally Posted by OldChap
that's 2 Petabytes!!!!Code:Name: XtremeSystems URLs crawled: 79,039,277,264 Data (MB): 2,002,147,406
Crunch with us, the XS WCG team
The XS WCG team needs your support.
A good project with good goals.
Come join us,get that warm fuzzy feeling that you've done something good for mankind.
I was crawling around 5 to 8 nodes to keep my 50Mb connection near full.... gradually been increasing to now where I have 20 * 225 workers and 75 buckets on one rig (i7 920 @ 4.0 with 16Gig and intel 520)
Not exactly a lot of work gone in to optimising number of workers though, Just now I am feeling that if they don't want to spend time fixing then nor do I.
My Biggest Fear Is When I die, My Wife Sells All My Stuff For What I Told Her I Paid For It.79 SB threads and 32 IB Threads across 4 rigs 111 threads Crunching!!
hear hear!
W00000000tttttt
"Study hard my young friend"[/B].
---------------------------------------
Woody: It's not a laser! It's a... [sighs in frustration]
Welcome back, citpyrc.e! Hope you stay a while
I think we hit an all-time new daily record yesterday
Me! Me! I do..I do!I think we hit an all-time new daily record yesterday
Crunch with us, the XS WCG team
The XS WCG team needs your support.
A good project with good goals.
Come join us,get that warm fuzzy feeling that you've done something good for mankind.
How about setting a date for such achievement?
"Study hard my young friend"[/B].
---------------------------------------
Woody: It's not a laser! It's a... [sighs in frustration]
Well, scrap that idea for a while...just as soon as the good buckets came, they disappeared
I noticed, ok, lets fly to England and toss Alex in the "Stocks" for a few days to make him rethink these POS buckets!Well, scrap that idea for a while...just as soon as the good buckets came, they disappeared
Crunch with us, the XS WCG team
The XS WCG team needs your support.
A good project with good goals.
Come join us,get that warm fuzzy feeling that you've done something good for mankind.
Let me pack a bucket of tomatoes!I noticed, ok, lets fly to England and toss Alex in the "Stocks" for a few days to make him rethink these POS buckets!
Posting Permissions
Reply With Quote
Bookmarks