Since the 1.6.12 node is starving half the time I said the hell with it and migrated all my nodes to the beta. Across 5 nodes I'm seeing a semi-steady 20-25mb(usually a steady 50) as long as there...
Type: Posts; User: DeadlyFire; Keyword(s):
Since the 1.6.12 node is starving half the time I said the hell with it and migrated all my nodes to the beta. Across 5 nodes I'm seeing a semi-steady 20-25mb(usually a steady 50) as long as there...
Is that last part of the chart running @30meg? :eek: If so steady crawling is gonna be hard to do without adding more nodes :cussing:
edit: spoke too fast, when the more normal buckets start...
If possible can you post a screenshot of the bandwidth graph(under the Charts tab with the 1min period) on the old node vs the new node? I want to see if the lack of reserved buckets has any big...
Can you post a screenshot of the Crawler tab of the Options menu? If I understand correctly reserved buckets are going to be severely limited in the new node :( Also, how often do you see NoMoreURLs...