Out For Blood

[[XC] gomeler]

Due to unforseen circumstances I was forced to move back onto my college campus. This means access to an ~80mbit pipe :D I'm still trying to figure out how to max out this setup as I don't want to setup another PC, looking at 3.2 million URLs for the day. Guess I'll do this until either the IT guys get pissed or I move off campus again.

[systemviper]

Hey G, Best of luck in your new place,\!


Regards
Steve

[DeadlyFire]

80mbit pipe!?? :slobber::lol: That's awesome news :D

[Frisch]

Your bloodthirst is welcome......:yepp:

[Movieman]

OOH, this is good news..:D
How much memory in that machine do you have?
VM's maybe?:D

[[XC] moddolicous]

Welcome back! I don't think that there is much that you can do other than tweak the heck out of the client. I dont know how it will work on a vm, but I guess its worth a shot. I just hope you wont be bottlenecked by how fast your computer can compress the buckets.

[Movieman]

moddolicous;3037786']Welcome back! I don't think that there is much that you can do other than tweak the heck out of the client. I dont know how it will work on a vm, but I guess its worth a shot. I just hope you wont be bottlenecked by how fast your computer can compress the buckets.

From my understanding the key is to install to different drives so no, you couldn't do 20 VM's like dimes but maybe 3-4 if you have the drives and enough memory.
I'd want to give at least 256MB per install

[[XC] gomeler]

Going to look into VM'ing the app over the weekend. Currently utilizing about 6mbit on this pipe, can't wait to push it :p: Currently have 1 gb of ram in there as the PC sits in a semi-public place and I can't risk losing my Dominators :p: Might have to get some cheap 2GB modules..

[Movieman]

gomeler;3037820']Going to look into VM'ing the app over the weekend. Currently utilizing about 6mbit on this pipe, can't wait to push it :p: Currently have 1 gb of ram in there as the PC sits in a semi-public place and I can't risk losing my Dominators :p: Might have to get some cheap 2GB modules..

Put all the settings to max and let it fly.
It should take at least 10mbit then.

[hixie]

Put all the settings to max and let it fly.
It should take at least 10mbit then.

:shakes: errors would be too high

[Mekoa]

This is what makes me curious. PY is hitting 13-15mbit on 2 clients. How does he do it?

My knowledge of how MJ12 works is minimal unfortunatly :(

Edit: Go go go Gomeler!

[hixie]

Mekoa;3038472']This is what makes me curious. PY is hitting 13-15mbit on 2 clients. How does he do it?

My knowledge of how MJ12 works is minimal unfortunatly :(

Edit: Go go go Gomeler!

You get losses depending on far away you are from your ISP and the quality of the line to your ISP. Then from the ISP to the web's backbone. If you're like me then the Trans-Pacific link kills speed and increases losses quite a lot.
Dave has 15MB up? and i have 100MB down, but passing through the Trans-Pacific link causes my downloads speed from him to drop to a few Mbps.
PY222 works in a datacenter, so my guess is that he is connected directly to the backbone of the web.

The next thing that really needs worked on is the .Net Framework, i bet Alex is cursing MS everyday cause of .Net :rofl:

[Mekoa]

Thanks for clearing that up Hixie. Explains my situation rather well :)

[[XC] moddolicous]

Well, I bet PY probably has mostly Asian domains selected, so hes probably getting rid of all the possible losses. Also, I bet he has the same client name used on a bunch, thats probably why he has 1 client with 13mbit used.

[Mekoa]

Same client name doesnt make a difference I believe (Ive had 2 machines called Anonymous before), but unsure completly.

Ive only selected UK, IE, GG, SE, DK and NO domains now, 99% of what I get is UK and Im only using about 80% of my line on a 24/7 basis. I do have another 3 projects running on that box mind you lol.

[[XC] gomeler]

16 hours uptime and 5.1 million URLs churned, 92% success rate. 16mbit average, looks like I have plenty of space to expand. Going to try and see if I can get 2 installations working in the same OS, otherwise I'll have to VM it.

[Movieman]

gomeler;3043738']16 hours uptime and 5.1 million URLs churned, 92% success rate. 16mbit average, looks like I have plenty of space to expand. Going to try and see if I can get 2 installations working in the same OS, otherwise I'll have to VM it.

won't work and with VM's make sure they each have a different HD..

[DeadlyFire]

won't work and with VM's make sure they each have a different HD..

Yep, one instance per OS. About running 2 or more instances on a single HD, you can do it, as long as your CPU is powerful enough to chew through both instances archiving simultaneously(I found if you increase the archiving delay in milliseconds when it comes time to archive, the system seems to run a little smoother. Having multiple hard drives helps reduce competition for HD read/writes between instances of MJ12. Hope the setup goes well :up:

[[XC] gomeler]

won't work and with VM's make sure they each have a different HD..

I've been monitoring the read/writes and it really isn't that intensive. Maybe 50 writes and 25 reads per second and only a few mb/s on both. Currently a little under 340mb total reads and 1800mb total writes in a little under an hour of crawling. Processor stays constantly loaded at 35% though as it's always compressing. Might need to install winrar and see if using the external executable will be any faster. Currently using 750mb of 1024mb though, so can't VM until I pop another stick in there. 6.5 million projected for today :cool:

[Frisch]

Winrar isn't a good choice, if you look at it from Alex's eyes.

And a side note.
The one time i tried it, i got nothing but trouble.

Just passing the experience on.

[[XC] gomeler]

Notes taken, avoiding winrar and just bumping the overclock from 2200 MHz to 3200MHz :cool:

[DeadlyFire]

Gomeler is on fire today!!! :eek: :up::up::up:

[Frisch]

Gomeler is on fire today!!! :eek: :up::up::up:
:yepp: :up:

Let's hope there's oxygen enough to keep both of you alive...;) :D

[Mekoa]

Damn, wish my machine crawled at 15mbit!

GJ :)

703,653,705 till we fry some fish btw :D

[[XC] gomeler]

This machine is hitting a wall around 6.2-7.2 million/day. Need to plop in more DDR2 and VM it, just lazy :D

[Frisch]

gomeler;3053624']This machine is hitting a wall around 6.2-7.2 million/day. Need to plop in more DDR2 and VM it, just lazy :D

Whatever you're deciding, your output is loved..............:D.......truly.......:D

[Mekoa]

Just noticed... Ive downloaded quite a lot lol.

9,999,129MB :o

[Frisch]

Mekoa;3056061']Just noticed... Ive downloaded quite a lot lol.

9,999,129MB :o

Humongous amount of data, 10 tera. :yepp: :up:

[Mekoa]

Well over 10TB now, damn lol.