Search:

No idea what is going on, but DNS errors have been through the roof. All nodes shut down while i find out the problem. :mad:

I guess i should start posting on the mj12 forum?

I've noticed my scores haven't changed at all. So i've looked at the traffic graphs, pfsense is saying i get on average about 20megabits per seconds, which curiously, if converted to megabytes is...

Update: Seem to have located and solved the problem. I by chance plugged another router into the modem for temporary wifi, and noticed there was plenty of speed and bandwidth available.
So concluded...

The onboard NIC is a dual port Intel 82576 chipset, i found 2 pcie Intel nics with the same chipset for a good price, and those are on the way to be tested.

I have DNSbench, and my ISP had the top...

Something interesting to note, all 8 nodes were being starved of work, when suddenly fresh buckets came in. You can see the 3 peaks on the left hand side, most likely from the archiving.
So CPU load...

The CPU load looks much better now, the only difference was 8 nodes versus 9.

http://www.lakecityquietpills.com/photo/multihost/images/87157835991960738722.png

Node #8, DNS errors are down now...

I'm down to 8 nodes now, CPU utilization went from overloaded to average 15% for some reason. Crawl stats is still ugly compared to my control.

And how the hell do you attach photos? doesnt seem...

Shut down another node last night, still don't know what is causing the high DNS and timeout errors.

I have a single node running on a windows machine, and that node averages about 10Mb/s. The crawl stats are much nicer than my linux nodes. Getting a high amount of timed out errors, gonna have to...

I've got some rather ugly crawl stats and had to remove 12 nodes. I'll try increasing the workers and see if that helps saturate my line. Does everyone have priorities set to normal?

Wish there...

Crawling will be stopped for a few days, heading to taiwan.

untangled installed on a E6600 with 1GB RAM. CPU load over 2 is supposed to be bad. Then what's gonna happen here? :rofl:

i kinda have untangled already setup and running in the office ... don't want to have to change everything. If i do change over i'll have to get another machine to have pfsense running and do a...

Anyone used untangled before? the attack blocker blocks 90% of MJ-12's activities. I've been getting mad errors.

:woot::woot::woot:

I had a problem where my ISP blocked my MJ-12 traffic. Called them and they opened it again in a week.

Back to the 8mbps line

Just confirmed 1,000mbps doesn't cover my area :(

Conditions allowed, crawling efforts have increased! :D
Might be able to upgrade to a 1000mbps fibre line :p:

That speed is only available with peers on the same network, if a server uses another company (which they all do) then you don't get that price.
Personally i really really hate Hong Kong Broadband,...

Prices are always jacked high with products that are still under NDA.

Rsvp! :D

I've been crawling for quite a while ... just not large figures, and been too busy to post here.

BTW dave, why aren't you going to vegas? I'll be there with a booth this year.

#9 please!



HK $800-1300! ;)