Welcome to the team :welcome:Quote:
Originally Posted by kodiak kid
Disclaimer...
We won't be responsible if your ISP complains about your bandwidth usage....mainly because we have our own to deal with. :p:
Printable View
Welcome to the team :welcome:Quote:
Originally Posted by kodiak kid
Disclaimer...
We won't be responsible if your ISP complains about your bandwidth usage....mainly because we have our own to deal with. :p:
Welcome to MJ12 and thanks! :DQuote:
Originally Posted by kodiak kid
Saw you in the stats page and had to come in here and welcome you! Thanks for joining the effort! :up: :up: :up:Quote:
Originally Posted by kodiak kid
thanks guys! Anything to help out ;)
Anything? I could use a couple of Q9450's ;)Quote:
Originally Posted by kodiak kid
all I have are QX9650s...sorry :D
Free upgrade? Sweet!Quote:
Originally Posted by kodiak kid
Kodiak... your Free-DC ststs sig is set up for Rechenkraft, not XtremeSystems. Just a heads up :up:Quote:
Originally Posted by kodiak kid
ummm...for which one? I am lost as far as this stuff goes as I just started like...2 days ago.
oh wait...I think I know what you mean...
this looks like another fun one to join, but i dont think ill be able to do it... i would hate to get FAP'ed by damn Huhges.net for my uplaod and download exceding thier limits :(
some of us live in the country, so no dsl, no cable, no wi-fi, no fiber... just your choice of dial-up or hughes.net
Yeah its not one for limited connection unfortunatly.Quote:
Originally Posted by skycrane
However, every little helps! :)
Welcome and thanks for contributing Kincaid_PC_Bryan!! :) :up:
So, I have a spare 2Meg broadband connection...what else is required here?
Whats the CAP on it? Is it free to download as much as you want?Quote:
Originally Posted by OldChap
The limit is 2 gig on the unused one (which comes free with my tv package) but unlimited ("subject to reasonable use") on my main
I would test crawl for a month and watch for any complaints from your ISP about the bandwidth usage. What ISP do you use?
Virginmedia for the unlimited and Sky for the other. The main has an acceptable use policy and throttles from around 4pm til midnight but they say they will advise if they consider any use unacceptable so after the big push I will give this a go.
What is optimal equipment for this?
Oh man this brings back memories. Hmm, maybe I can start back up once I get home for the summer
Anything will run MJ12, from single core to quad core; it uses around 50-150 megs ram. A little configuring on the node and you should be good to go. Any questions, ask :up:Quote:
Originally Posted by OldChap
We'll be waiting for you :DQuote:
Originally Posted by [XC] moddolicous
Ok so I downloaded and set it up as per the guide (a bit old, there are more options to consider now). On my daily rig to start off q6600 xp 4(3)meg and on my normal connection...
http://www.speedtest.net/result/824421947.png
Knowing what you guys all worked out already.....any tweaks to offer?
50meg line?? :eek: That will definitely make a difference for XS!(eat your heart out MtM, I know you're lurking :D:p:) How many workers do you have set for each MJ12 node? I currently have 4 nodes with 215 workers and 200 buckets per node on a 50/20 line. Is this line unlimited in bandwidth usage? Majestic 12 eats up gigs like nobody's business(I go through a terabyte in less than 3 days not counting non-MJ12 usage :nuts:) Try a test run to make sure your router and whatever else doesn't run into any problems then further fine tuning can be done. Good luck and if you have any questions ask away! :up:Quote:
Originally Posted by OldChap
Hey...Total noob here ...You may need to do screenshots or more detailed hints.. :)
got this on my Vista rig (ss) I still live on XP so a hint on this too please
Running in the order of 10,000 an hour on the xp rig...what should I get???
That error is from Vista having some problems writing to the location the Majestic 12 folder is in. Go into the Programs(x86) folder and find the Majestic 12 folder. Right-click cut and paste the whole folder into C:Quote:
Originally Posted by OldChap
http://i.imgur.com/4UEfp.png
After you do that you may have to make a new shortcut to your desktop for Majestic 12(open the Majestic 12 folder you just moved, right-click MJ12node.exe and Send to, and Desktop(create shortcut)
10,000 is low for a 50mb line :eek: Go to the Tools button at the top menu then click Options, then take a screenshot of the Connection, Crawler, and Archiving tabs.
Qx on Vista is started ...Thanks for that
Now for the XP screenshots
I've used your screenshots and edited them with red numbers for the changes:
In the Connection tab, did you mean to say 50Mbps for the Downstream box? (I'm going off of the info from the speedtest result you posted a couple posts above) The current setting is set at 5Mbps if I'm right which is probably really limiting your output. Try these new settings and see what results you get after an hour(don't forget to restart the majestic 12 node after applying those settings).
Both reset....will report back later. :up:
.... as usual to start with I don't understand a bunch of the settings/terminology but I will get there eventually
Deadly, You have behaved like one of the WCG guys in your willingness to assist. Many thanks for your help...It seems the community ethos has spread :yepp:
Quote:
Originally Posted by OldChap
We're a small group here in the XS MJ12 section but very close knit :toast: :) Dave and the rest helped me when I first started and I'm glad to be able to do the same :up:
Well hopefully these numbers will help... first is xp second is vista
incidentally I asked for UK only on the XP rig and any on the other
That's much better :) Now try increasing the number of workers in the Crawler tab under Tools>Options from 175 to 230. Is that screenshot from the Windows XP machine? If so, there is a tweak that can help. Windows XP has a default limit of 10 maximum TCP connection attempts it can make per second in order to slow down the spread of worms from infected machines over the internet. However, this also limits MJ12 to 10 connection attempts per second, but the limit is adjustable through a patch. This limit doesn't exist in Vista or Win 7.Quote:
Originally Posted by OldChap
Download it here: http://www.lvllord.de/download.php?u...tch223d-en.zip and then after it's saved to your computer, open it and run the EvID4226Patch.exe file(it may popup as a virus alert, but it is safe to run). After it opens, type the letter 'c' then type 5000, then letter 'y'. If everything goes perfectly it should say 'installation done' and should do a countdown and afterwards ask you to restart your computer.
Increased.... yep left ss is xp and I've dl'd and run that.
running again but it is teatime here...renowned for my connection slowing some till later in the evening....I'll have another look at this around this time tomorrow then maybe you can appraise the results so far.
It will be interesting to see if my ISP notices this as being outside of their "acceptable usage" limit that they have on their unlimited broadband
Again, thanks for all your help
You're getting 300k+ URL's per hour which is damn good(which may rise a little more after the new settings) :D :up: Only other advice I can give to increase more points is to add more nodes. Otherwise your golden :up: Keep an eye on your emails or however you're ISP communicates with you and see what they say(if they do). If they complain you can either lower the settings in MJ12 or run it at only certain times of the day or night. Also, any errors in MJ12 or internet related problems let us know.Quote:
Originally Posted by OldChap
Thanks again for joining!! :toast:
One quick question... when This picks up on a site that gets flagged by AVG or multiple addresses of the same site as I have just now ... do I need to take any action?
No.Quote:
Originally Posted by OldChap
You are not in any way infected. Let AVG know it's ok.
That's good news.... so I've upped the ante and put it on a third rig (I just remembered I put a 250 gig drive in that one....the others are a bit small)....now to see how it effects our normal internet use :shrug:
I know I won't get half a mill an hour but I can try for over 10 mill a day :up:
Like Frisch said disregard any virus alerts from MJ12, you're safe :) 10 mill is a great addition to the team :up::up:Quote:
Originally Posted by OldChap
Duh :up:. Now there's a name I didn't see in a while.
Checked before bed last night and found lots of connection errors on the third rig (x3350, 2gig, Vista) It crunches and folds too so I may have to look at the settings later. Its connected to a 10/100 hub too not a switch and should share with rig2 ... Time for some more learning :)
Talk about being out of the loop..
I check at the MJ12 site today,see the team in the #3 position,doa"That's better than normal"then openupthe team tab and see 5mil+ beside this "Old Chap"name..
Then I do a"Son of a Biatch"..
Didn't know the UK had fast lines..
Thanks for helping Old Chap!
Greatly appreciated!:clap:
Well I did say I'd take a look at this......and nothing from my ISP yet.....I'm thinking that my daily rig might get a rest for a couple of hours around this time of day so I may have to lower my sights a bit....quite a lot if rig 3 is mem limited
What time do the stats update on this? normal DC time? or do you guys use something different?
yup,12:01am your timeQuote:
Originally Posted by OldChap
So, a little update. Just one screenshot of the xp rig which ran the whole 24 hours. MJ12 stopped on the 1st Vista rig after about 1.5mill so I've rebooted that and am watching..will record what happens if it fails again. The 3rd rig is now running again, re-booted, but with one card less folding....just to observe the result when there are more resources available
Anyone want to comment on parts spec eg on hard drives that would improve this or am I wholly reliant on internet speeds? also...
Under Charts the mem tab shows nothing on the graph ...normal or not?
Not Good here :(
Xp machine just seemed to be MJ stopped showing connected and crawling but v.high conn errors. restarting MJ alone did not help ....needed a reboot ....the total was only just over 5 mill so only ran for about 8 hours since the ss above
Vista1 had re-started :shrug:
Vista2 similar to Xp but locked sooner
My feeling is that is is filling some buffer to its maximum and locking up
See my post to your thread on the MJ12 forum. I had the same problem because my router simply couldn't handle it. The solution is to buy a better router(more expensive option) or to slowly lower the number of workers per node until the locking up stops happening. So for 3 machines, with 175 workers each, try lowering the amount of workers to 165 per node. Repeat the process by lowering the # of workers 5-10 per node at a time until the freezing stops happening.Quote:
Originally Posted by OldChap
Here's a reference:
Well I just up'ed my BW that this project is using hopefully I won't get a letter from Charter... the magic 8 balls says "It's decidedly so."
DeadlyFire and OldChap thank you for helping make this easy.
nice to hear! :D Keep on crawling :up:Quote:
Originally Posted by Mr_Slinky
Would someone like to explain how to reduce my DNS error rate? Is this some function of the network or connection? or is it a rig thing?
You can change the DNS server your computer uses instead of relying on the one your internet service provider offers you. I have Verizon as my ISP but I use Sprint DNS servers on my home network because they are consistently faster. There is a benchmark tool that allows you to test your computer on dozens of different DNS servers and see which DNS servers are fastest. Download linkQuote:
Originally Posted by OldChap
Follow these instructions here to change your DNS: http://www.sevenforums.com/tutorials...ndows-7-a.html (they should also work for WinXP) At the end where it says to put 2 IP addresses into the box, do not use the ones the instructions give you, but use the ones that were the fastest from the benchmark tool below(the SS is of my results so make sure to rely on your own test data). If your current DNS servers are as fast or faster than the other servers in the chart, then leave them as-is.
The load we are going through now is bad, and you shouldn't worry about the DNS, it's the same for all of us. Alex will have new ones soon, and you will see errors go down again. Most errors are general, and are related to the quality of the buckets.
Don't panic, it's ok. : )
Thanks guys
Deadly, My router connects through a cable modem so it reports a single IP and I know nothing about the modem (ISP supplied) .....I have work to do learning this methinks
Haha, I forgot how much fun majestic12 is (I'll be making random appearances until I'm home in late June). Going over the last couple posts, I think I can chime in. Oldchap, your router is going to be the weakest link in your chain for a while. Back when I was a contributor, I had an IPCOP machine set up. It was basically an old Pentium 2 machine with 128mb of ram, and I set that up as the router, attached to a switch. 10mil a day from me was easy if I remember correctly (not sure). After your router, either the cpu or hard drive will be the limiting factor. I am not sure how an ssd would hold up to MJ12, cause of all the writing.
Ok then guys....I have some ddr2 and a 5050e so I need to buy a MB and PSU to build a router...the psu could be almost anything from a power point of view but the MB ...I've been thinking of a Gigabyte GA-MA770 UD3 (lots of pcie x1) thoughts anyone?
The final question is about NIC's...... any makes to watch for or avoid?
Incidentally, it is always the same rig that falls over ...usually with conn errors...tonight I will try it instead of my daily rig so still just running 2 rigs...I already stopped GPUGRID on it so here goes nothing
funny you mention this because I'm currently building my own router right now :D any parts will do, for the NICs stick to Intel, they're the tried and true, and easily supported by linux firewall/routing software(pfSense, IPcop, smoothwall, etc). I'm planning on installing pfSense on my router because it has a lot of configure-ability and seems to be the most updated. The limiting factor in your router will probably be the memory, cpu then hard drive. Routing eats up a lot or ram(home routers usually don't have more than 64-128mb and MJ12 puts a beating on them).Quote:
Originally Posted by OldChap
With your own router you need two nic cards, one will be for incoming internet WAN connection from the wall to your router(nic #1), and the other will be outgoing from the router(nic #2) to either your switch, your old router(if you can put it in bridged/switch mode) or directly to a computer(if more than 1 computer needs internet, use either a switch, turn your old router into 'switch mode' or simply add more NIC cards to your router). I decided to add more NIC cards to my router so there is less overhead. Intel NIC cards are about $30 on newegg, but you can get them much cheaper on ebay. I bought 5 of these from one seller and he gave me a bulk discount($8 per nic card). If you go for the multiple nic cards option, make sure your motherboard has enough PCI-E/PCI slots! If you decide to get a switch, you can find one for under $50 at newegg
Here's a diagram to visualize it:
http://i.imgur.com/TC8Lv.png
Mem = 2gig, 5050e = 2* 2.6gig, HD = 80gig 5400 sata (8M cache?) run on ubuntu? pfSense (what OS for this?)....this is my idea just now
Broadcom are the most common NIC's on ebayUK (at least cheaper ones anyway) Heard of them?
Yup I've heard of them,as long as they work OK then it should be fine; I would post here which one you plan to buy to rule out any incompatibilities before buying. pfSense is based on FreeBSD so it is its own OS basically(no need to install an OS). That 2 gigs ram will definitely be very handy. HD and CPU are good to go as well.Quote:
Originally Posted by OldChap
Here's a list of FreeBSD compatible NICs http://www.freebsd.org/releases/7.2R....html#ETHERNET
Welcome back :):up:Quote:
Originally Posted by [XC] moddolicous
Thanks. I can help a little bit with the machine issue. Your machine has PLENTY of overhead for a router (like I said, I used a pentium 2 and it handled he workload fine). I used the IPCOP distro, which worked awesome. The only reason I had to stop it was that I used a hard drive I found, and it was bad, so once the power went out, the OS install got corrupted, and it was no good anymore :( Towards the end of last summer I was going to put together a Pfsense machine, just cause I liked the idea of trying something new, and it also sounded much easier to set up a wireless ap from Pfsense rather than IPCOP. Things got in the way, and it never happened. That being said, I am going to try again once I get home.
Hello moddo............:welcome:
Moddo is the author of our guide. :up:
Are you back to get a majestic fix........:D
Well looks like I have everything up and running, wish I had more bandwidth. I used to have 40Mbps and now the ISP scaled it back to roughly 15Mbps :( Either way up and running looks like I'll be getting roughly 450k daily...not bad :D How are some of you on upward of 1 million, multiple locations running?
Nice :) Welcome :up::up:Quote:
Originally Posted by =[PULSAR]=
Welcome to the team! From a 15Mbps line, you should be able to get more than 450k daily. How many workers do you have it set for? If you take a screenshot of the connection, crawler and misc tabs, I can give you some recommendations as far as settings if you want.Quote:
Originally Posted by =[PULSAR]=
Okay thanks I'll post some up in a little bit, I feel like I have a pretty strong connection I can download things at up to 3 Megabytes/seconds I'm having a tough time understanding it I should easily be in the millions.Quote:
Originally Posted by [XC] moddolicous
The only things I would really think about changing is maybe increase your upload speed. It wont really hurt anything, but it could help. I don't think the client will ever max out your upload speed, so even if you set it for something ridiculous, you should be fine. I also like to check the DO NOT USE PROXY FOR Uploading, even though it probably doesnt do anything. Crawler page?
Well... I dumped the Gigabyte ep45t ud3r rig as even at 100/30 it still locks up after a few hours. Now I have the Supermicro DP board running and it already went longer that the Giga ever did.
My main problem just now seems to be upload speed.... lots of very sloooow uploads are not helping .....this means I will be limited to around 8mill/day....still playing with crawler settings though :)
Hey PULSAR here are some suggestions:
http://imgur.com/OWT8E.jpg
http://imgur.com/vfds0.jpg
In the upload speed field I wasn't sure what you have for your upload speed so I put 1Mbps. If your speed is lower it will use whatever you have up to 1Mbps; If your speed is higher than 1Mbps than increase it to that amount.
Can you try running a speedtest to check your upload speed? speedtest.netQuote:
Originally Posted by OldChap
I agree with Deadlyfire (I couldn't see your crawler page yesterday for some reason :shrug:) Definitely change the fixed upload chunk and increase it, unless you ran the upload benchmark and that came out best for you. You can lie about your upload speed to Majestic12. In my experience, it never reaches whatever I set, so even if I set it for 15Mbps upload, it will just upload as fast as my connection allows. You can also lower the Robots txt flush delay and URL flush delay to 0. Alexc said that this is a setting from the old days, but I feel like it can't hurt. Also, if you use this machine daily (or someone does), put everything on normal except upload (leave that on high always). If this is dedicated, then I would put everything on above normal, except upload (leave on high). Whenever I put certain functions on high, the program seems to hang for some reason :shrug:
Change your settings, restart the client, and report back in ~3hours and tell us how it is going :up:
It's going much better already, I think the big thing I was missing was restarting the client. Didn't realize you had to, to have the changes take effect.
EDIT: After 10 mins I found my average is going to be roughly 6.2 million PPD. :D
Deadly,
http://www.speedtest.net/result/837779962.png while crawling
http://www.speedtest.net/result/830161452.png normal non crawling
The common report along the bottom of the crawling screen is "upload stopped due to a connectivity problem will try later" and in the log " 05/06/2010 21:30:03] Could not connect to server to start uploading, looks like it's down, will retry later." appears for many lines one after another.
Where can I see how many buckets are waiting to upload?
EDIT: Alex reminded me that I'm running this concurrent with WCG so there is bound to be some interaction
Well I am pretty sure my ISP started questioning my bandwidth after a day of use. After changing some settings I was running at great speeds average of 16k kbits/seconds. After about 2 hours straight of watching it the bandwidth has stop to a dead crawl 200 kbits/second. Checked my internet bandwidth with multiple speed tests and getting 20k kbits/second. Ugh I think they are starting to block certain things.
That is definitely possible :( Some ISPs hate bandwidth junkies and MJ12 eats up bandwidth like crazy. I would try to lower your settings so you can still crawl but remain under the radar(lower the amount of workers to 50-100 and watch the crawl rate and data usage in MJ12). It is also possible that your ISP has a set data limit(ex.20 gigs) and once you reach it they downgrade your speed until a certain condition is met(24 hour limit, usage drops, etc.) I'd call your ISP to see if you can find out this limit and how you can stay under it without angering the ISP gods :up:Quote:
Originally Posted by =[PULSAR]=
Your upload speed looks good so that can be most likely ruled out. I've already replied on Alex's forum but those upload errors you see happen some of the time. As long as they do not prevent you from uploading completely(i.e. if it causes you to have a huge backlog of uploads waiting to upload), then I would not worry about it.Quote:
Originally Posted by OldChap
Here's a visual on how a bucket upload backlog looks like:
NO BACKLOG:
http://imgur.com/2D9mp.png
BACKLOG:
http://imgur.com/jGUvy.png
The two numbers refer to the number of buckets that are waiting to be uploaded and what the size of the total buckets waiting to be uploaded is in megabytes. In the case above, there are in total 5 buckets, with a combined size of 10MB waiting to be uploaded. As long as the backlog isn't bigger than say, ~50-100MB then there's nothing to worry about. Looking at my log right now I can see about a dozen "upload timeout" messages.
Just looked it up and spoke to someone I am capped at 200GB download/upload a month. So far MJ12 has only used 34GB since yesterday? I can't imagine where the rest went. I only run WCG and GPUgrid, other than that I just surf. I don't torrent or anything. Hmmmm:confused: and then when ask if they could check where I stand on monthly usage they couldn't tell me.Quote:
Originally Posted by DeadlyFire
from alexQuote:
Router gone down again in our office - ******* piece of ****.
Give me 2 hours to deal with it - needs to attend some urgent stuff first I am afraid
Alex's router is unfortunately being hammered and keeps crashing :( It's probably because of the increase in downstream bandwidth capacity in the last few weeks and higher crawling rate as a project overall so it's not all doom and gloom. Hopefully he gets the router issue sorted out soon :)
I'll add to the grief.
I usually runMJ12 on mytwo Harpertown machines and Sammy.
One Harper sold, the other came down to night tobe cleaned and to get ready to sell soI'm at one machine pulling 15mbit vs 3 pulling 26-29mbit until I rearrange things here.
Oh so this is how we managed to afford the retail westmeres :p: What kind of broadband package do you have. I'm really upset about my capped 200GB a month :(Quote:
Originally Posted by Movieman
Is the remaining machine's cpu completely consumed by WCG? You could try some VM's :hehe: If not no worries, moddolicious and OldChap are really giving me(and a few teams) some competition :DQuote:
Originally Posted by Movieman
Nope, a spur of the moment thing.. Time to sell them.Quote:
Originally Posted by =[PULSAR]=
Remaining machine is a group of parts as I needed the case to fit my new beastie in..Quote:
Originally Posted by DeadlyFire
You'll see..24 cores, real cores..:rofl: and green..
Pics tomorrow if I can get it done tonight..
4 cases before I found one it would fit into and line up on most of the standoffs..
This board with 2-12 core AMD Magny cours cpu's in a Lian Li G70 case.
Ok,back to work, talk later..
http://www.newegg.com/Product/Produc...82E16813131643
Quote:
Originally Posted by Movieman
:shocked::D
My contribution is going to be sporadic until I get home for the summer (June 28th). Once I get home, I'll set up a Pfsense router, figure out wireless on it, and then have a pretty good contribution daily.Quote:
Originally Posted by DeadlyFire
Hey Moddo, I don't know what you can achieve when you get home but just now it ain't too shabby :up: ...trying to make sure I don't catch you huh? :)
I need to be building a router too...I can run two rigs ok but when I add a third I get connectivity problems with uploads even if I run @ 100/30...now this could be my poor upload speed but I prefer to think I can get more using pfsense
Routers always struggle with the uploads, I can assure you of that. Also, did you max out the archiving settings? Word Size = 128 bytes and Dictionary size= 16mb? I find that helps. Having a stronger router also helps a lot. I dont remember how much I used to do daily, but if I remember correctly, I used to be close or in the Top10 daily. My output now is decent, but it is kind of sporadic at best.
Picked up a few nic's for the router project
2* Intel 8390MT 1000M Gigabit Desktop PCI Network Card
1* HP NC380T PCI Express Dual Port Multifunction Gigabit
1* HP NC360T PCIe DUAL PORT GIGABIT NETWORK CARD
The hp parts are Intel based so there should be no problem there but I maybe should have asked about mixing cards (or maybe more to the point multiple drivers). These give me 6 ports ....so wan + 5 one of which I want to put my wireless n on if possible
I feel a number of questions coming on when I build this one :)
Oldchap, its awesome that you decided to make your own router. Did you decide on a distro yet? I can help you with IPCOP and possibly smoothwall, as I have a little experience with both. Pfsense, I will throw in my :2cents: but I may not be as much help.
No choice really, the one I have will just about run 2 rigs....add a third and "connectivity problems" on the uploads.....Now, this might be a function of the 50/1 but I can rule that out with this.
I've seen people talking about pfsense as best so I will give it a try.....just that on a rig because I have never run a VM and the total spend will likely be £150 so cheaper than a business router I think.
I have a Dell psu spare ...just have to be sure it is not different pinouts on any of the plugs. Haven't found the right MB yet though....might have to trial it on the max formula :)
Hmmm, I never ran it through a vm, so that is up to you. Before I had a computer dedicated to it. If Pfsense is anything like IPCOP and smoothwall ,you will have (in the beginning) two interfaces: red and green. Red is the bad, unprotected Internet. You will plug a cable in directly from your router to the red interface. The green interface is the good, protected Internet. You will run a cable from here to your switch, and then on to your various computers. Now, the Wireless interface (blue) is the one that I wanted to read up more on. I think with pfsense, there are two things you could do. 1: Plug in another NIC card and run the cable from there to a wireless router or 2: Use a wireless card that directly plugs into the PCI slot. I always thought the second option would be much cooler, but I never had a chance to mess with it. Make a new thread with pictures when you are setting it up and I'm sure everyone will help as much as possible. Good luck
Well, that's it for me I think ....As of today I have 1 machine set up with 3vm's on which I will run this as the VM seems faster than the host???? Whatever crawl rate I get, I will stick with that and hopefully it will run error free. I have the PFSense router which apart from slowly using more and more ram (was at 3% a month ago now it is 17%) has been problem free.
Rumor has it that any time from late this year and rolling out over the next 12 months my ISP is going to increase the upload speed to around 10% of download. My guess is that I could possibly double my output when that happens.
So for now the WCG machines (which also fold GPU in winter) can have their cycles back and hopefully there will be no more babysitting on a daily basis so that I can get on and build something new (just something to keep my mind on for the next few weeks ;)...you all know why)
Quote:
Originally Posted by OldChap
Do you have any buckets-to-be-uploaded backlogs now? If not then it's a sign the uploading side of things is working well. A download speed increase would be more awesome :D
sidenote - is Alex's site offline? or is it just me? stats don't load for me :confused:
Stats don't seem to be updating but app is working fine for me..Quote:
Originally Posted by DeadlyFire
Also wanted to say congrats on the 4 billion!:clap:
Oldchap:
Do what your comfortable with.
Rather have you here long term that way than trying to max out your line and getting frustrated.
Slow and steady sort of thinking if you get my drift..;)
MM Sorry if you read it differently but that was what I was saying.....Whatever output this gives me now is, by my way of thinking, the max I can get with this connection, so, that is it....the best I can do.
Over the course of the next week I will look at the difference between running 2vm's and 3vm's ...the past 48 hours I have run 3vm's + 1 in the native os. but the behavior so far is similar to running separate machines albeit with a lower output as the buckets to be uploaded backlog for each has dropped from 300-400 to 100ish
Deadly, The reason I think a better upload will help is shown in the PFSense traffic graph...
I have 50/1.75 as settings fixed in my modem...the 16 hours average shows I am using arount 50% of the download but the upload is balls to the wall.
When, in the past, I turned off downloads to shift the backlog then I can return results at well over 100 buckets an hour.
When I turn off uploads My download average moves to 30+ meg
Conclusion: due to the requests for connection when crawling the uploading of buckets is starved of bandwidth and to be running at full speed one needs a connection that has an upload speed of at least 8% better yet 10% of download
I almost let loose a brick in my pants when I saw this in my Verizon email this morning :nuts:
:eek2::eek2:
http://newscenter.verizon.com/press-...-internet.html
http://i.imgur.com/Rfg4b.png
Also read somewhere: "Verizon tells us they're considering updating the 50 Mbps tier to 60/35 Mbps, but that they haven't yet made the official move."
Christmas has come early this year!! :wasntme: :D
Bah. Apparently if the central office in your area isn't fitted with GPON tech and on the older BPON distribution then the highest speeds aren't available(just yet :hehe:)Quote:
Thank you for contacting the Verizon eCenter. I have received your
email dated 12/1/10 regarding if we offer a speed of 150/35 Mbps for
FiOS service. My name is Jennifer, and I will be happy to assist you.
We appreciate your interest in a faster FiOS internet speed.
I apologize. We do not currently offer a speed of 150/35Mbps. The
fastest speed that we currently offer is 50/20 Mbps.
Are you really aiming to have 150/35Mbps ?? holy piece of pipe. you will need some really good networking gear to be able to max that, right?
He's already looking out for deals on fiber networking :D
Look out Dave your top spot is "on the line"
yeah, he is cheating big time :PQuote:
Originally Posted by OldChap
Dave with his 30 mbit line ( which is becoming small thing nowadays) and his mkv downloadings ( IE avatar) has no chance to remain in the top 10 for much longer :rofl::rofl::rofl::rofl:
Surprisingly not :) All you need is a good *nix or BSD based firewall and a pc to load it on and it will handle the highest network loads as good as a $10,000 Cisco :up: On my current line at max throttle I see 90,000 NAT table states which pfSense handles fine(a consumer router would DIE :p:). I'm gonna call Verizon and talk to a live person because their online vs their phone operators say different things about sale promotions/packages sometime :shrug:Quote:
Originally Posted by Duh
I'm still years away from Dave, nothing to worry about(yet :lol:)Quote:
Originally Posted by OldChap
:( the best I see just now is around 30,000
I'm looking forward to my upgrade whenever it comes ...the upload I have kills me
I have a job for you deadly, Idiots guide to multiple instances of MJ under linux on the new 1.7.0.
Once you have that cracked I would love to see just how much one quad could do :up:
Quote:
Originally Posted by DeadlyFire
In my case what dies is the f.. modem if many packets go through it ( both cablemodem and adsl). have you replaced the modem?
I'm very curious as well. That's one of my top goals for 2011! :up: I wish I could donate some of my upload to you, pfSense shows about 4-6 Mbps total upload being used while running MJ12 full throttle and the rest of my 20Mb goes unused.Quote:
Originally Posted by OldChap
Do you have cable or dsl? I know those 2 require a modem and a router(if you plan on adding a second pc). Fiber optics only requires a device called an ONT which translates the light signal from optical to digital and then you can plug the CAT5 cord from it directly into your pc or into a router(or even a switch I believe).Quote:
Originally Posted by Duh
Every router I received from Verizon could not handle MJ12 but a pc-based pfSense firewall(based on OpenBSD) is like comparing a Ferrari to a Lada, blows it out of the water :) Most routers/modems are incredibly underpowered(weak cpu/low memory) but then again they weren't made in mind for MJ12 :p:
your fiber makes me hate yoy . You do not even need modems , thats amazing. I have both dsl and cable. Both have modems and get stuck very often.Quote:
Originally Posted by DeadlyFire