Gratz on 300mill Deadly!
As for fluctuation, my line does that a lot. Usually between 5000-7500 or so on my main machine.
Gratz on 300mill Deadly!
As for fluctuation, my line does that a lot. Usually between 5000-7500 or so on my main machine.
< MB / CPU > Asus X99 Pro / Intel Core i7 5820K
< MEM / GFX >Corsair Vengeance 16GB DDR4 / EVGA GeForce GTX 780 Ti SC ACX
< PSU / HSF > OCZ Z-Series 1000W / Phanteks 140PE
< CASE / OS > Phanteks Enthoo Primo / Windows 7 Home Premium x64
< STORAGE > Samsung 840 EVO 120GB - Samsung 840 250GB - 2 x Seagate Barracuda 3TB - Intel Intel X25-M 80GB
Thx bro
How do you get the crawler to not fluctuate?? My client usually stays around 10k-15kbps but there are huge jumps and dips here and there; Since you're basically "visiting" multiple websites which then is logged in MJ12 under "successful/not found/timed out/etc." then wouldn't it defy logic since different websites will take slower to load(size difference/location) than others and will cause jumps in the graph?
Only way I can think of is by only crawling domains near to your location.
Ie if i crawled only UK domains, line should fluctuate less as they are all local.
< MB / CPU > Asus X99 Pro / Intel Core i7 5820K
< MEM / GFX >Corsair Vengeance 16GB DDR4 / EVGA GeForce GTX 780 Ti SC ACX
< PSU / HSF > OCZ Z-Series 1000W / Phanteks 140PE
< CASE / OS > Phanteks Enthoo Primo / Windows 7 Home Premium x64
< STORAGE > Samsung 840 EVO 120GB - Samsung 840 250GB - 2 x Seagate Barracuda 3TB - Intel Intel X25-M 80GB
Welcome indeed!
Riptide hit that question on the head. Does take a few machines to max out a line.
Stats are looking good today so far also! Im slacking as my 24/7 machine fell over yesterday, think it got a little hot :o
Code:1 XtremeSystems 17,122,450 430,525 2 Knights Who Say Ni! 8,322,353 224,781
< MB / CPU > Asus X99 Pro / Intel Core i7 5820K
< MEM / GFX >Corsair Vengeance 16GB DDR4 / EVGA GeForce GTX 780 Ti SC ACX
< PSU / HSF > OCZ Z-Series 1000W / Phanteks 140PE
< CASE / OS > Phanteks Enthoo Primo / Windows 7 Home Premium x64
< STORAGE > Samsung 840 EVO 120GB - Samsung 840 250GB - 2 x Seagate Barracuda 3TB - Intel Intel X25-M 80GB
Xtreme millions = many
Kippers millions = not so many
Excellent
~Opinion about Dogs~~~~~~~Hug~~~~~~~~
~~~~
________________________________________________
Burns : Isn't there a word that goes beyond Xtreme, Smithers.
Smithers : That would be infinity, Sir.
Burns : Aaah, I like the sound of that. But how much is that, smithers.
Smithers : That's not to say, as it is endless, Sir.
Burns : Oooh, that means i can't see, or feel it, smithers.
Smithers : I'm afraid not, Sir.
Burns : Hmmm, I do like to observe my incoming, so let us hold on to Xtreme, Smithers.
Smithers : Yes, Sir.
Burns : Now that'll be all, away you go, Smithers....Hush Hush.
Smithers : Yes, Sir.
~Opinion about Dogs~~~~~~~Hug~~~~~~~~
~~~~
________________________________________________
.NET 10mbps doesnt really affect me. Line only ever syncs at 9mbit heh.
Crawling seems a bit odd today, hardly done anything this afternoon but its still active.
Issues with MJ12 or beta 1.6?
< MB / CPU > Asus X99 Pro / Intel Core i7 5820K
< MEM / GFX >Corsair Vengeance 16GB DDR4 / EVGA GeForce GTX 780 Ti SC ACX
< PSU / HSF > OCZ Z-Series 1000W / Phanteks 140PE
< CASE / OS > Phanteks Enthoo Primo / Windows 7 Home Premium x64
< STORAGE > Samsung 840 EVO 120GB - Samsung 840 250GB - 2 x Seagate Barracuda 3TB - Intel Intel X25-M 80GB
I'm running 1.6.1, which has some memory leaking problems, but Alex has advanced on to 1.6.3.
It has some funny problems, so I would wait to the final, if you haven't upgraded to the beta versions.
Besides the memory leak, it sometimes spin around with a archiving it won't end.
Repeating step 1 and 3, and reporting missing file.
Had to delete it. Did it a couple of times again, with a day between, but hasn't done it since.
One positive thing.....it crawls more url's.
Last edited by Frisch; 03-13-2008 at 09:03 PM.
~Opinion about Dogs~~~~~~~Hug~~~~~~~~
~~~~
________________________________________________
Had a busy 2 days and just found this thread..
Congrats on the 300 mil deadly!
Frisch that turtle in the first post looks nasty!
I have one machine down for a few days, the quad, long story but a profitable one for me.. NEW quad will be up late next week when parts arrive.
Let's get the frying pan hot for those kippers!
Crunch with us, the XS WCG team
The XS WCG team needs your support.
A good project with good goals.
Come join us,get that warm fuzzy feeling that you've done something good for mankind.
Frying pan? I like mine smoked! If you know what i mean
Crunch with us, the XS WCG team
The XS WCG team needs your support.
A good project with good goals.
Come join us,get that warm fuzzy feeling that you've done something good for mankind.
I live off whatever is given to me by parents Ah the joys of still living at home!
Gonna upgrade beta versions later, think its 1.6.0 im using?
< MB / CPU > Asus X99 Pro / Intel Core i7 5820K
< MEM / GFX >Corsair Vengeance 16GB DDR4 / EVGA GeForce GTX 780 Ti SC ACX
< PSU / HSF > OCZ Z-Series 1000W / Phanteks 140PE
< CASE / OS > Phanteks Enthoo Primo / Windows 7 Home Premium x64
< STORAGE > Samsung 840 EVO 120GB - Samsung 840 250GB - 2 x Seagate Barracuda 3TB - Intel Intel X25-M 80GB
Smoked salmon is tasty. Though I cant eat a lot of it
Ive only had 2 slices of toast today, do believe I need some proper food!
In process of potentially buying some new equipment also. Stuck in a conundrum as to what though. So many Intel choices
< MB / CPU > Asus X99 Pro / Intel Core i7 5820K
< MEM / GFX >Corsair Vengeance 16GB DDR4 / EVGA GeForce GTX 780 Ti SC ACX
< PSU / HSF > OCZ Z-Series 1000W / Phanteks 140PE
< CASE / OS > Phanteks Enthoo Primo / Windows 7 Home Premium x64
< STORAGE > Samsung 840 EVO 120GB - Samsung 840 250GB - 2 x Seagate Barracuda 3TB - Intel Intel X25-M 80GB
i like fhis
< MB / CPU > Asus X99 Pro / Intel Core i7 5820K
< MEM / GFX >Corsair Vengeance 16GB DDR4 / EVGA GeForce GTX 780 Ti SC ACX
< PSU / HSF > OCZ Z-Series 1000W / Phanteks 140PE
< CASE / OS > Phanteks Enthoo Primo / Windows 7 Home Premium x64
< STORAGE > Samsung 840 EVO 120GB - Samsung 840 250GB - 2 x Seagate Barracuda 3TB - Intel Intel X25-M 80GB
Maybe all 3? All this talk about fish is getting me hungry I went fishing o Oneida Lake(a.k.a Walleye heaven) a few weeks back around 2am light rain, about 33°F and windy Spent 2 hours and right as I was gettin ready to leave BAM, caught a nice 22" Walleye. Quite tasty
Ive never fished a day in my life. Think Im going on holiday to Wisconsin in summer (lake house hooray). Might try my hand at some fishing then
< MB / CPU > Asus X99 Pro / Intel Core i7 5820K
< MEM / GFX >Corsair Vengeance 16GB DDR4 / EVGA GeForce GTX 780 Ti SC ACX
< PSU / HSF > OCZ Z-Series 1000W / Phanteks 140PE
< CASE / OS > Phanteks Enthoo Primo / Windows 7 Home Premium x64
< STORAGE > Samsung 840 EVO 120GB - Samsung 840 250GB - 2 x Seagate Barracuda 3TB - Intel Intel X25-M 80GB
Bookmarks