View Full Version : Are these numbers any good???
FragTek
03-22-2007, 02:35 AM
Well I setup MJ12 last night and got it crankin'...
Woke up this morning (about 7.5 hours later) and between my two comps I've crawled 733,000 URL's. Is that good, bad, or indifferent?
Frisch
03-22-2007, 03:08 AM
That's estimated about 2,4 mill a day. :up:
There's a number of ifs here, where you are crawling (domains), and how much you allow the line to use, amount of workers, and open url's.
This is a fidling program.
FragTek
03-22-2007, 05:04 AM
See I don't have anything advanced setup... Both boxes allow up to 100 workers each and 20 URL buckets.
My primary box is able to use 24mbit down and 2mbit up, my Dell box is able to use 18mbit down and 1.5mbit up. I have noticed however that I never see either one using more than about 8mbit, and my average is about 2.5mbit on both boxes. Is this just due to the servers being in the UK and me being in the US?
2.4mil a good number?
Frisch
03-22-2007, 05:14 AM
No, not if you are running those lines, didn't know you had that at your disposal.
FragTek I have a meeting in five, movieman, or whoever is online will guide you, and if not i'll be back later.
But one thing, it has nothing to do with the servers, cause you are crawling the net, the only thing you have to do with the servers, is getting url's, and upload them back.
You'll never hit your top, the average will always stay somewhere below the top, but try to set your domains to US only, and nearby. Under tools you can select preferred domains.
FragTek
03-22-2007, 05:53 AM
Yeah I currently have a 30/2.5 line and in about a week or so I'll have 60/5 at my disposal so I need to get this setup to utilize as much of that as possible.
When I get home I'll try setting my domains to US only and see if that helps out a bit.
Is there a "recommended" or known good number of workers and buckets?
Thx all :) Glad to be of service!
Martijn
03-22-2007, 02:03 PM
FYI: I managed to do ~1 mil/day out of a 4/1 line. MJ12 is a lot of tweaking/testing, but I got crapped by my ISP... :(
FragTek
03-22-2007, 07:30 PM
What are the main things I should be tweaking to try and get the most out of it?
Movieman
03-22-2007, 08:25 PM
What are the main things I should be tweaking to try and get the most out of it?
FIRST we need to get you to join the team!
Your cranking those numbers and not on any team from what I see at FreeDC stats page!
I saw you put up almost 3 mil today..nice start!:toast:
FragTek
03-23-2007, 06:12 AM
FIRST we need to get you to join the team!
Your cranking those numbers and not on any team from what I see at FreeDC stats page!
I saw you put up almost 3 mil today..nice start!:toast:
How do I join the team?!?!? :D I couldn't figure that out either, yes, i'm a re-re.
3 mil, not to bad I guess... I can't seem to get my main box to average any higher than about 5mbit downstream though :(
Frisch
03-23-2007, 07:19 AM
How do I join the team?!?!? :D I couldn't figure that out either, yes, i'm a re-re.
You register Here (http://www.majestic12.co.uk/forum/profile.php?mode=register&agreed=true) (allows you to post in the forum as well)
Or Here (http://majestic12.kicks-ass.org/teams/team.jhh?teamid=60&join=1)
Then you log in and join XS by pressing Join this team.
Movieman
03-23-2007, 07:25 AM
You register Here (http://www.majestic12.co.uk/forum/profile.php?mode=register&agreed=true)
Then you log in and join XS by pressing Join this team.
Thank you oh Turtle from on high!( or is that turtle thats always high?):p:
Frisch
03-23-2007, 08:28 AM
Thank you oh Turtle from on high!( or is that turtle thats always high?):p:
To fully understand the soul of a Turtle, you need to realize the slowness, of movement in real time.
It's thoughts are as a weapon designed to distract the real time, by letting it's awareness be way ahead of it's physical presents, you could misunderstand this as being high, in the terms of it reacting ahead of the actually event.
Is this making any sense for the normal mind, no, not at all, and that's why.........
It's a killer tank on four extremely sweet feet.
:p: :D
Movieman
03-23-2007, 08:33 AM
To fully understand the soul of a Turtle, you need to realize the slowness, of movement in real time.
It's thoughts are as a weapon designed to distract the real time, by letting it's awareness be way ahead of it's physical presents, you could misunderstand this as being high, in the terms of it reacting ahead of the actually event.
Is this making any sense for the normal mind, no, not at all, and that's way.........
It's a killer tank on four extremely sweet feet.
:p: :D
as if I can actually make sense of this drivel after being up all night?
Be kind and remember that at my age brain cells need lots of coffee to understand turtlespeak..:D
Frisch
03-23-2007, 08:44 AM
The drivel, is what make us superior. :p:
PS
You quoted my misspelling you evil man, it's really hard to grab a pen, not to talk about writing, being a Turtle. :mad: :D
FragTek
03-23-2007, 11:14 AM
OK I think I'm in! Someone double check me and make sure :p:
Now to see how I can get more than 3mbps average out of MJ12....
Frisch
03-23-2007, 05:00 PM
OK I think I'm in! Someone double check me and make sure :p:
Now to see how I can get more than 3mbps average out of MJ12....
You are :thumbsup:
Stats are Here (http://www.majestic12.co.uk/projects/dsearch/teaminfo.php?id=60) and Here (http://stats.free-dc.org/new/teamstats.php?proj=maj&team=XtremeSystems)
Movieman
03-25-2007, 07:19 AM
OK I think I'm in! Someone double check me and make sure :p:
Now to see how I can get more than 3mbps average out of MJ12....
Now we need you back on MJ12..Yea, we're relentless!:)
Did I see you say you had a 60/5 line coming?
You on FIOS also?
You don't even want to know what that line would do.
Maybe 15 mil a day.:slobber:
Martijn
03-25-2007, 11:12 AM
Now we need you back on MJ12..Yea, we're relentless!:)
Did I see you say you had a 60/5 line coming?
You on FIOS also?
You don't even want to know what that line would do.
Maybe 15 mil a day.:slobber:
McIntosh managed 15m/day from 20Mb :D
You should triple it :p: