Majestic 12 Milestones.

[DeadlyFire]

I just looked at the XS team stats page and we have 10 active crawlers today!

[hixie]

[Frisch]

I just looked at the XS team stats page and we have 10 active crawlers today!

Look who's the last......weeeeeeeeeeeeeeeeeeeeeee

[Mekoa]

Grats to all for some huge milestones!

I really need to sit down when I get time and see if I can fix my clients

Edit: Installed new 1.7.0 client, appears to be running well!

[DeadlyFire]

Good to have you back Mekoa!

today that makes it 11

[Mekoa]

Good to have you back Mekoa!

today that makes it 11

I have a habit of speakin too soon. It started dropping tons of errors around 2 hours in. Main was Conn Errors or Retries. Boo

Either I'm getting really crap buckets or something is stopping my traffic from going through.

[DeadlyFire]

In the options menu, under the Crawler tab, what do you have set for the last section(Hard errors)? also, what is your 'max priority buckets' set to?(under the 'more crawler' tab)

[Mekoa]

In the options menu, under the Crawler tab, what do you have set for the last section(Hard errors)? also, what is your 'max priority buckets' set to?(under the 'more crawler' tab)

Threshold 10, all options checked.

Max Priority Buckets set to -1

Edit: Dropped threshold to 1 as a test, still generating lots of Conn Errors.

[DeadlyFire]

Threshold 10, all options checked.

Max Priority Buckets set to -1

Edit: Dropped threshold to 1 as a test, still generating lots of Conn Errors.

Try setting threshold to 100 and priority buckets to 0 temporarily. Check the results over the next couple hours(it will take some time for remaining priority buckets to clear out).

[Mekoa]

Try setting threshold to 100 and priority buckets to 0 temporarily. Check the results over the next couple hours(it will take some time for remaining priority buckets to clear out).

Changed and running now. I left it on after snoozing, it destroyed my internet within windows. Couldnt hit a single webpage, even though no bandwidth was being used.

[DeadlyFire]

Changed and running now. I left it on after snoozing, it destroyed my internet within windows. Couldnt hit a single webpage, even though no bandwidth was being used.

That's the priority buckets causing that, Dave experienced that as well. I would start with those set to 0 then slowly raise it(maybe by 1 at a time).

[Mekoa]

That's the priority buckets causing that, Dave experienced that as well. I would start with those set to 0 then slowly raise it(maybe by 1 at a time).

Im guessing thats probably what my original issue was then. Been running a few hours now with around 78% success and I can still use interwebs!

Cheers Deadly, could be on to a winner here.

[DeadlyFire]

Great! If you're willing you can try to raise it to 1 and see how it goes. If it makes the connection unusable or causes huge amount of errors then stick to 0.

[OldChap]

I'm doing this too now. I restarted and sent back 8 late buckets. That should be first in first out if you ask me with the priority buckets getting done with all the rest.

I keep running into too many buckets open too which must be all about the priority buckets setting not working properly.

Normally on my connection I get a state table size of around 40,000, Last night it was pushing 100,000 so just to see what would happen I upped the limit to 1,000,000 and it immediately went to 130,000

Just now although it will run this is broken as most controls don't work.

[DeadlyFire]

Yep definitely the priority buckets I say set it to lowest possible or 0 even(i'll add another 20 across my nodes to cover your share of those ) and call it a day.

[Duh]

so current best is to set it to 1?

I did not know that threshold trick

thx

[hixie]

Anyone used untangled before? the attack blocker blocks 90% of MJ-12's activities. I've been getting mad errors.

[DeadlyFire]

Can't say that I have but I did look into it before choosing pfSense. I know in pfSense you can install packages to do network IDS, not sure about Untangle

[hixie]

i kinda have untangled already setup and running in the office ... don't want to have to change everything. If i do change over i'll have to get another machine to have pfsense running and do a straight change over, with minimum down time.

UPDATE: i made an exception for my computer through the attack blocker, but cause untangled is on transparent bridge mode i have no control over the local IPs and all IPs are renewed every 24hrs