I'm not getting any WU for over half an hour here even though it responds to pings. :mad:
Printable View
I'm not getting any WU for over half an hour here even though it responds to pings. :mad:
yeah, my plate is empty too..
If you connect via browser like posted in "Do this first" it responds with "ok" though.
Just got a WU via 171.64.122.74.. just a hiccup?
I just downloaded a new one about 10 minutes ago.
Yep I got a fresh one also a little while ago so they must be back up and serving.
came back up, but down again this morning.. it's up http://171.64.122.74/ just not accepting or sending..
This is F@H's way of saying, "Take a short break to play a 3D game on that GPU"? ;)
With these unstable GPU WU server und some buggy SMP WUs it's no wonder my ppd keeps jumping up and down like crazy. God, I'd wish for stability. Is that asked too much? :shakes:
i really wish it was up, my gfx card is begging for more work!
I'm still folding on a WU I was doing before i shut off my main computer. 3 Cards now want to upload and it'll be a 4th soon.
They need more servers and better IT. This is annoying.
I wonder if its possible to catch up to the number of WUs they can put out? I mean with 250k+ people folding, many with multiple GPUs....?
Its working now. :D
yeah, 20 mins ago the first wu again. pfft...
Yep working now confirmed. :)
QFT
I posted something along these lines regarding their frequent stats failures and caught flak from peeps. I don't see why we can't be more demanding of SU to improve their infrastructure and management. :shrug:
Spoken like a true fah veteran... anyone that's been around the pande game long enough has had a beef with the group's inept management of the project. probably more than one actually. I've been thru quite a few spells myself, where I swore I was gonna quit folding because of it. I actually did one time for about a month, but came back.
I'm folding since 2002 with little breaks, but back then I never paid attention to points or fah community in general, everything was easy. Just this solid standard client, and boy was I proud as I started folding on my shiny new dual XP WS rig. Now I'm more into points/fah community and all these server failures, broken wu, and stuck up mods and people over at fah forums just spoil all the fun. I'm pretty happy that I joined XS at folding efforts, otherwise I might have already shut down the clients for good.
:rofl: And I was worried my disdain for the frequent downtime and poorly written clients would be looked down on here. :yepp: It seems I fit right in. :up:
For those that might be running ATI GPU2 clients, the server is down. Also the SMP 171.64.122 is down. Both already reported. :shakes:
171.64.122.74 down again...
and I just got my new 9800gt installed..
it's not even an hr old http://www.newegg.com/Product/Produc...2E16814121268R
it's in desperate need, like a virgin on prom night :rofl::ROTF:
GPU server has been up and down more than a hooker's panties recently...
OK, here's one...
the fah server has gone down more than Paris Hilton...
Britney Spears ?
My office is blissfully quiet....
but no folding being done :(
I just had 2 that got thru 6 and 8 min ago, so maybe things are picking back up..
Sparky - I meant from the WU server being down. There is a noticeable noise difference between folding and not folding.
I even can tell a difference from when I sent one of my GPU down the hall to a student to use for some benchmarking.
Just a couple of thoughts:
I've been having this random inability to upload WUs also. 1 thing that works sometimes on GPU2 is closing the client
and restarting it.
Another thought for those who also run Boinc: GPUGRID.net now has a
GPU client for Boinc. Its not completely....what?....Stable?...No, that's not the word. :cool: I don't know....it
can be somewhat of a pita, I guess. :p: But there are work-arounds and they are seriously working on the client.
It runs pretty well overall...with a little bit of understanding. Anyway, anybody that interested in filling in some of
the F@H down-time with another GPU client should check it out. There is an XS team already. I'm #1.....uh....out
of 2 active and 4 total. :D Anyway, I've no doubt that they can use the help with getting WUs completed and
feedback on the forums would be a big plus...no doubt. :up: If anybody decides to check it out and needs
some help--just let me know. :up:
The servers at F@H have been horrible the last couple of months now I do not think they have made it though a weekend without going down in serveral months. I am not sure even Britney or Paris could claim that one. :rofl:
it seems to be back up and running now...
sucky servers
Too bad: I noticed my HD3850 being quiet for a while. Oh well: it does dozens of WUs daily, so I'm happy I'm contributing to science.
again http://171.64.65.20/
http://fah-web.stanford.edu/serverstat.html
171.64.65.20 GPU vspg1 densign full Reject
8800GT and 9600GSO are both idle right now :(
Weaksauce...:down:
One 9600GSO is idling quite some time now, the other one is 10% away from running dry. Cheers Standford, they don't seem to have ever heard of redundancy. :shakes:
Its down for me right now.
2 of 4 cards folding atm. I'm taking a nap. The servers better be up when I return of there's hell to pay!
Great I have a gpu2 client just about to finish and I read about Stanford's dodgy servers going down again just great! :(
Yeah I don't understand their setup at all. Why not setup a redundand load balancing based on some OpenBSD machines (or what ever) so the clients on the outside talk to just one IP. Behind this load balancer they then setup their little server park. Nice and easy. Why rely on this erroneous round robbing on the client side of things. :shrug:
again this morning since
00:50:20 PDT 2008 171.64.65.20 GPU vspg1 densign full Reject
http://fah-web.stanford.edu/logs/171.64.65.20.log.html
Mornin Mike...Yepper, the server is doing the Paris Hilton again.:rofl: Couple that with the :mad::mad::mad::mad: windows update. Huge interference with our production.
yeah, I got a winders vista update last night on all 4 machines at 3am... l have them set to auto update... and it was a reboot update. I guess I should change them back to "download updates only", but last month I got sick of manually doing it.. so I set them to full auto... it's a pita to go around and click install, then wait and wait while it updates, then reboot each one. I'd rather wake up and find them at the login screen already updated. so I have them on all on full auto.
I don't like auto updates on anything but my AV. Other than that, manual only. Just tell me when the updates are there and I'll take care of them at my convenience.
I tried using ubuntu linux, maybe I'm not brainy enough for it but I couldn't figure out what the heck I was doing :lol2:
Naw Sparky it was not that you are not brainy enough its a medical condition caused by extended prolonged use of Winblows. After repeated extended prolonged use of Windblows the users brain starts to shut down to conserve brain power. It would not be good for the user to be smarter than the OS. The only known cure is the immediate installation of a Smart OS "Linux" at which time the user can start to exercise their brain again to reverse the atrophy which occurred while running Windblows.:rofl:
yeah, I used llinux when smp folding was king...
now that I want both smp and gpu, Vista 64 is just easier...
I started using it last year for Home premium and media center on my main rig for recording tv.. when gpu came along and xp flubbed with it's whole core requirement for each gpu client. I converted them all to vista64... just dont tell ms.. :rolleyes:
I have a legit retail copy, paid like $180 for it last year.. it just happens to be registering more than one of my personal rigs.. though I never have it on more than one machine at a time. (disclaimer). ;)
Maybe someone here will know. I have heard that you can use a 32 bit key with a 64 bit disc. I have Vista 64 Ult installed on my system but I am getting ready to build another and also have a copy of Vista 32 Ult. Will I be able to use that key with my 64 bit disc so that I don't have to buy another copy?
Retail 32/64 one key
OEM 32/64 one key
oem and retail are not interchangeable. so f you use a oem disc you need an oem key.
and if you use a retail disc, you need a retail key.
but they are the same key for 32 or 64 bit.
when you buy ultimate you get 2 discs, but only one key for one machine. so if you try to use that key on another machine, it's activation will fail,.. you're gonna have to call and do the phone activation dance and tell them it's on one machine to manually actiavte. otherwise it wont activate and go into reduced functionality mode at 30 days. legally you can only have a retail copy key on one machine at a time, but you can transfer the key from machine to machine, as long as you only use it one machine at a time... OEM is only for the machine you first installed it on, nontransferable.
I bought my Vista ultimate from school, cost me $90. Now I see I can get it for $65 straight from MS :rolleyes: Maybe I should grab another copy before I graduate? :shrug: Anyway, it only came with the 32 bit SP1 disc from school, but I had an image ISO from MS for the 64 bit, just no SP1. I used that anyway, then installed SP1 afterwards. Same key used. I've not touched the 32 bit disc.
I still have my 32 bit XP Pro from school that was on my PC not in use now. Not sure if I'll stick that on my laptop when I put the larger HD in it or if I'll just use the XP Home that came with the laptop :shrug: Also have an XP pro 64 bit key and disc, it came with the 32 bit XP Pro when I bought it. Never have used it...
Sweet. I have two keys. I got 32 bit Ult OEM and 64 bit Ult OEM from Intel with a key for each. I thought that the retail and OEM discs were the same. My discs show two different version of each flavor.
retail ultimate comes with both 32/64 media and uses the same key http://www.royaldiscount.com/miwiviulfuve7.html
oem's are sold seperately so they have different keys because you're buying 2 keys.
http://www.royaldiscount.com/miwiviulfuve11.html
http://www.royaldiscount.com/miwiviulfuve8.html
I'm pretty sure you can still use a oem 32 key on oem 64 media... but since they are sold separately, it always gets it's own key because you're buying it that way..
if you have 32 bit and want 64 bit media, you can order it for $10 http://www.microsoft.com/windowsvist...a/default.mspx (media only, no key)
this is how I got my 64 bit media. my key came with 32 bit home premium way back when it first came out (no sp1)... but I use the spare 64bit media with the orig 32 bit retail key, since 32 is pretty useless for me.
Is it just me or are the WU servers down again today?? cards are idling...
EDIT: NVM.. must have been a server hiccup, both cards are trying to fold again, needless to say i still have EUE's like theres no tomoro. Anybody need some EUE's? i have plenty!
Mine's been attempting to get a WU for a couple hours now. I don't get it.
mine have been doing the wait in line dance since last night off and on. just let them go, they eventually pick one up.
one of mine waited over 4 hrs early this morning.
Code:[06:38:48] + Number of Units Completed: 129
[06:38:52] - Preparing to get new work unit...
[06:38:52] + Attempting to get work packet
[06:38:52] - Connecting to assignment server
[06:38:53] + Could not connect to Assignment Server
[06:38:53] + Could not connect to Assignment Server 2
[06:38:53] + Couldn't get work instructions.
[06:38:53] - Attempt #1 to get work failed, and no other work to do.
Waiting before retry.
[06:38:59] + Attempting to get work packet
[06:38:59] - Connecting to assignment server
[06:38:59] - Successful: assigned to (171.64.65.106).
[06:38:59] + News From Folding@Home: GPU folding beta
[06:38:59] Loaded queue successfully.
[06:39:00] + Could not connect to Work Server
[06:39:00] - Attempt #2 to get work failed, and no other work to do.
Waiting before retry.
[06:39:13] + Attempting to get work packet
[06:39:13] - Connecting to assignment server
[06:39:13] - Successful: assigned to (171.64.65.106).
[06:39:13] + News From Folding@Home: GPU folding beta
[06:39:14] Loaded queue successfully.
[06:39:14] + Could not connect to Work Server
[06:39:14] - Attempt #3 to get work failed, and no other work to do.
Waiting before retry.
[06:39:36] + Attempting to get work packet
[06:39:36] - Connecting to assignment server
[06:39:36] - Successful: assigned to (171.64.65.106).
[06:39:36] + News From Folding@Home: GPU folding beta
[06:39:36] Loaded queue successfully.
[06:39:37] + Could not connect to Work Server
[06:39:37] - Attempt #4 to get work failed, and no other work to do.
Waiting before retry.
[06:40:30] + Attempting to get work packet
[06:40:30] - Connecting to assignment server
[06:40:30] - Successful: assigned to (171.64.65.106).
[06:40:30] + News From Folding@Home: GPU folding beta
[06:40:30] Loaded queue successfully.
[06:40:31] + Could not connect to Work Server
[06:40:31] - Attempt #5 to get work failed, and no other work to do.
Waiting before retry.
[06:42:05] + Attempting to get work packet
[06:42:05] - Connecting to assignment server
[06:42:09] - Successful: assigned to (171.64.65.106).
[06:42:09] + News From Folding@Home: GPU folding beta
[06:42:09] Loaded queue successfully.
[06:42:09] + Could not connect to Work Server
[06:42:09] - Attempt #6 to get work failed, and no other work to do.
Waiting before retry.
[06:44:57] + Attempting to get work packet
[06:44:57] - Connecting to assignment server
[06:44:57] - Successful: assigned to (171.67.108.11).
[06:44:57] + News From Folding@Home: GPU folding beta
[06:44:57] Loaded queue successfully.
[06:44:58] + Could not connect to Work Server
[06:44:58] - Attempt #7 to get work failed, and no other work to do.
Waiting before retry.
[06:50:26] + Attempting to get work packet
[06:50:26] - Connecting to assignment server
[06:50:26] - Successful: assigned to (171.64.65.106).
[06:50:26] + News From Folding@Home: GPU folding beta
[06:50:27] Loaded queue successfully.
[06:50:27] + Could not connect to Work Server
[06:50:27] - Attempt #8 to get work failed, and no other work to do.
Waiting before retry.
[07:01:08] + Attempting to get work packet
[07:01:08] - Connecting to assignment server
[07:01:08] - Successful: assigned to (171.64.65.106).
[07:01:08] + News From Folding@Home: GPU folding beta
[07:01:08] Loaded queue successfully.
[07:01:09] + Could not connect to Work Server
[07:01:09] - Attempt #9 to get work failed, and no other work to do.
Waiting before retry.
[07:22:33] + Attempting to get work packet
[07:22:33] - Connecting to assignment server
[07:22:33] - Successful: assigned to (171.64.65.106).
[07:22:33] + News From Folding@Home: GPU folding beta
[07:22:33] Loaded queue successfully.
[07:22:34] + Could not connect to Work Server
[07:22:34] - Attempt #10 to get work failed, and no other work to do.
Waiting before retry.
[08:05:18] + Attempting to get work packet
[08:05:18] - Connecting to assignment server
[08:05:19] - Successful: assigned to (171.64.65.106).
[08:05:19] + News From Folding@Home: GPU folding beta
[08:05:19] Loaded queue successfully.
[08:05:20] + Could not connect to Work Server
[08:05:20] - Attempt #11 to get work failed, and no other work to do.
Waiting before retry.
[08:53:27] + Attempting to get work packet
[08:53:27] - Connecting to assignment server
[08:53:27] - Successful: assigned to (171.64.65.106).
[08:53:27] + News From Folding@Home: GPU folding beta
[08:53:27] Loaded queue successfully.
[08:53:28] + Could not connect to Work Server
[08:53:28] - Attempt #12 to get work failed, and no other work to do.
Waiting before retry.
[09:41:33] + Attempting to get work packet
[09:41:33] - Connecting to assignment server
[09:41:34] - Successful: assigned to (171.67.108.11).
[09:41:34] + News From Folding@Home: GPU folding beta
[09:41:34] Loaded queue successfully.
[09:41:34] + Could not connect to Work Server
[09:41:34] - Attempt #13 to get work failed, and no other work to do.
Waiting before retry.
[10:29:38] + Attempting to get work packet
[10:29:38] - Connecting to assignment server
[10:29:39] - Successful: assigned to (171.64.65.106).
[10:29:39] + News From Folding@Home: GPU folding beta
[10:29:39] Loaded queue successfully.
[10:29:39] + Could not connect to Work Server
[10:29:39] - Attempt #14 to get work failed, and no other work to do.
Waiting before retry.
[11:17:52] + Attempting to get work packet
[11:17:52] - Connecting to assignment server
[11:17:53] - Successful: assigned to (171.67.108.11).
[11:17:53] + News From Folding@Home: GPU folding beta
[11:17:53] Loaded queue successfully.
[11:17:54] + Closed connections
[11:17:54]
[11:17:54] + Processing work unit
[11:17:54] Core required: FahCore_11.exe
[11:17:54] Core found.
[11:17:54] Working on queue slot 06 [October 27 11:17:54 UTC]
[11:17:54] + Working ...
[11:17:54]
[11:17:54] *------------------------------*
[11:17:54] Folding@Home GPU Core - Beta
[11:17:54] Version 1.15 (Mon Oct 13 11:11:30 PDT 2008)
[11:17:54]
[11:17:54] Compiler : Microsoft (R) 32-bit C/C++ Optimizing Compiler Version 14.00.50727.762 for 80x86
[11:17:54] Build host: amoeba
[11:17:54] Board Type: Nvidia
[11:17:54] Core :
[11:17:54] Preparing to commence simulation
[11:17:54] - Looking at optimizations...
[11:17:55] - Created dyn
[11:17:55] - Files status OK
[11:17:55] - Expanded 45352 -> 246265 (decompressed 543.0 percent)
[11:17:55] Called DecompressByteArray: compressed_data_size=45352 data_size=246265, decompressed_data_size=246265 diff=0
[11:17:55] - Digital signature verified
[11:17:55]
[11:17:55] Project: 5800 (Run 2, Clone 563, Gen 11)
[11:17:55]
[11:17:55] Assembly optimizations on if available.
[11:17:55] Entering M.D.
[11:18:01] Working on p5800_supervillin_e1
[11:18:02] Client config found, loading data.
[11:18:02] Starting GUI Server
[11:19:18] Completed 1%
Yup same here, extremely long pauses until "Could not connect to Work Server" goes away and the cards get a new WU. That coupled with EUE's... GPU folding is not fun atm. -_-;
I restart the client 20-30 times after the first "Could not connect to Work Server", then I get a WU instead of waiting until the client decides to actually do some work lol...
yes... it is a grim time for us GPU folders...
Like Mike, I've been having problems since last night. 5-7 clients down at a time. Please post here!!! http://foldingforum.org/viewtopic.ph...p=64315#p64315
Hammer them with complaints before they go home so we aren't suffering through another night of no work!! :up:
I just questioned why the heck the clients always get assigned to the borked server instead of getting switched off to another functional server instead. You'd think that it would make sense :rolleyes:
On my main gaming rig. I'm turning it off now as I'm going to bed. Hope they get this sorted soon :(Code:[23:51:45] - Ask before connecting: No
[23:51:45] - User name: Anarki (Team 36362)
[23:51:45] - User ID: 3501A2D07F7DEDFE
[23:51:45] - Machine ID: 2
[23:51:45]
[23:51:45] Loaded queue successfully.
[23:51:45] Initialization complete
[23:51:45] - Preparing to get new work unit...
[23:51:45] + Attempting to get work packet
[23:51:45] - Connecting to assignment server
[23:51:46] - Successful: assigned to (171.64.65.106).
[23:51:46] + News From Folding@Home: GPU folding beta
[23:51:46] Loaded queue successfully.
[23:51:47] + Could not connect to Work Server
[23:51:47] - Attempt #1 to get work failed, and no other work to do.
Waiting before retry.
[23:52:01] + Attempting to get work packet
[23:52:01] - Connecting to assignment server
[23:52:01] - Successful: assigned to (171.64.65.106).
[23:52:01] + News From Folding@Home: GPU folding beta
[23:52:01] Loaded queue successfully.
[23:52:02] + Could not connect to Work Server
[23:52:02] - Attempt #2 to get work failed, and no other work to do.
Waiting before retry.
[23:52:16] + Attempting to get work packet
[23:52:16] - Connecting to assignment server
[23:52:17] - Successful: assigned to (171.64.65.106).
[23:52:17] + News From Folding@Home: GPU folding beta
[23:52:17] Loaded queue successfully.
[23:52:18] + Could not connect to Work Server
[23:52:18] - Attempt #3 to get work failed, and no other work to do.
Waiting before retry.
[23:52:38] + Attempting to get work packet
[23:52:38] - Connecting to assignment server
[23:52:39] - Successful: assigned to (171.64.65.106).
[23:52:39] + News From Folding@Home: GPU folding beta
[23:52:39] Loaded queue successfully.
[23:52:40] + Could not connect to Work Server
[23:52:40] - Attempt #4 to get work failed, and no other work to do.
Waiting before retry.
[23:53:31] + Attempting to get work packet
[23:53:31] - Connecting to assignment server
[23:53:31] - Successful: assigned to (171.64.65.106).
[23:53:31] + News From Folding@Home: GPU folding beta
[23:53:32] Loaded queue successfully.
[23:53:32] + Could not connect to Work Server
[23:53:32] - Attempt #5 to get work failed, and no other work to do.
Waiting before retry.
[23:54:54] + Attempting to get work packet
[23:54:54] - Connecting to assignment server
[23:54:54] - Successful: assigned to (171.67.108.11).
[23:54:54] + News From Folding@Home: GPU folding beta
[23:54:55] Loaded queue successfully.
[23:54:55] + Could not connect to Work Server
[23:54:55] - Attempt #6 to get work failed, and no other work to do.
Waiting before retry.
[23:57:39] + Attempting to get work packet
[23:57:39] - Connecting to assignment server
[23:57:40] - Successful: assigned to (171.67.108.11).
[23:57:40] + News From Folding@Home: GPU folding beta
[23:57:40] Loaded queue successfully.
[23:57:41] + Could not connect to Work Server
[23:57:41] - Attempt #7 to get work failed, and no other work to do.
Waiting before retry.
u would think that they would figure some sort of switching system out :shakes: I love the idea of folding, but all the technical problems lately... well... it's not making it a fun process. We are supposed to be helping research so that people will not have to suffer, yet we sit here with cards idling, definitely suffering :down:
Yay no work for me! And my last WU got hung!!! :clap:
3 WU's folding, one waiting to be sent.
Thanks to the F@H servers for ruining my folding race so far!
i finally got wu's for my 5 g92's - but man, i got home from work and all 5 were idle.
this sucks.
I honestly believe that they don't have enough projects queued up. It is most likely a manual process to load the projects to the work servers. I doubt that they have anything sophisticated like SNMP traps to alert when the server-side services are mal-functioning or need attention. Feels like it's all very manually-intensive. They must have a few grad students running around slapping bubble gum and bailing wire on the things to keep them up and running...
:rofl: My thoughts were along the lines of... the bean counters don't take the project seriously and expect them to get by with the equivalent of whatever P4 class server chips would be. IT runs around trying to do the impossible with nothing and the forum mods take the heat. The bean counters need to cut loose with some Alumni dough so they can upgrade everything. :rolleyes:
Just checked and all my gpu's are idle :(
They must be using P2s and coat hangers for cable... :shakes:
The strange thing is that I had one of my cards idling for 5 hours during the night, while the other one was folding, with big pauses, but still folding. So I played the on/off game again and now it's folding again. To me it seems their infrastructure is borked.
2 of mine have been idle for 6hrs (since 10pm last night).
I just force fed one when I woke up just now... took 8 launch attempts.
I think they have a faulty vacum tube.:rofl:
in their brain... http://www.scootplace.net/smiles/original/116.gif
Just figured it out...This is their server PSU...:rofl::rofl::rofl::ROTF::rofl:
This is more likely to be their server PSU, and they're way to lazy to feed it.
Attachment 87891
here's a picture of it after maint was completed last night.. :(
http://img407.imageshack.us/img407/4...dservercw6.jpg
Now that's funny :rofl:
Someone please get Paris Hilton out of the server room...It goes down enuf without her help...
Guys do you really enjoy the PG bashing? Gheezzz....Quote:
:rolleyes:
I think the PG needs to acquire the services of some real world IT professionals to redesign their server setup and help them acquire the equipment needed to keep the project operating smoothly its pretty obvious right now that they don't have what is needed for that.
Do you even realize the amount of traffic that goes through their servers? Have you set up networks for companies/organisations which handle that much data? Do you realize that besides collecting and serving the wu's they have to be recorded as well as analyzed when they are returned?
Their job involves a whole lot more then keeping our HW fed, and we should be abit less laying blame on them for being so succesfull. Because that's what this is, the load is high because they got allot of donators, because they got a good project and a good cause.
I'm getting abit sick off all the bashing...
All i am going to say is 45 tries :shakes:
No Marvin I have no Idea whats required for a project this size with the traffic it has to handle only server IT experience I have is with my own little home server and network. Its just frustrating when the same servers keep going down day after day without any real improvement I am sure if I really knew what was involved I would be more understanding my frustration I am sure comes from ignorance of what is really involved and from an end users perspective. I meant no disrespect to the PG group I was just venting some of my frustration at the problem and not being able to do anything about it on my end.
I was just joking about the P2s and coat hangers and anyone with just a little bit of common sense should no this. However if the results are really important and need to be done as quick as possible and returned as quick as possible one would think there would not be nearly as much problems as there are...
RR - to be fair, pure text is a horrible medium for communicating in a casual context :). Especially with our international friends...sarcasm, irony, tounge-in-cheek humor, etc, these things can get lost easily.
I agree that it's important that PG gets this sorted out ASAP.
I vote let the joking continue. it was fun and relieved stress for all of us in a time when the server is having issues. and kept people involved even if it was just to laugh until they fix the server traffic issue. the jokes are not meant to be taken seriously, so if you cant laugh about it, ignore it..
@Marvin_The_Martian
Were only messing around buddy and in fact I do know what it takes to setup a complex network - why it was only two weeks ago when I was required to install and integrate 3 Cisco 2960 catalyst switches for a company who had £45M (~$88M) worth of transactions going through their network, a night. If I had of messed up then I would of been hung :eek:
The guys at Stanford are obviously getting funds from sponsors to run FAH. They just need a decent infrastructure or network team to help them out.