Show Off Your Server!

[Duh]

Looks gorgeous man
s0lid: how much could a L5520 eat? Ah you live in a civilized country with high costs of electricity

[Hawkeye4077]

power bills are overraited..

if it aint crunching, its a waste :p

My old C32 system cost about $80/month running WCG full tilt.. When it is 1/3rd of my entire electricity bill it had to go... bad for everybody (especially the science)

[NKrader]

Servers the way they are meant to be! on cardboard

[Levish]

My old C32 system cost about $80/month running WCG full tilt.. When it is 1/3rd of my entire electricity bill it had to go... bad for everybody (especially the science)

According to ILO our newer DL380p's (production) use between 175w - 200w on average (less than 250w peak), Dual Hexa / 384GB ram, not counting storage, 2x of them run approximately 60 production server vm's.

Servers have come a very long way in terms of power consumption in real world use versus ~ 5 years ago when something like this would be running on several Gigawatts on physical hardware.

Synthetic benchmarks may / may not be so kind but the combination of new hardware and virtualization has improved power efficiency by orders of magnitude for our use case at least, and we do pay for power use in the form of how many 20a 120v circuits we have to buy with the data-center provider.

[WrigleyVillain]

power bills are overraited..

Sure...for those on the teat of Bonneville dam!

[Hawkeye4077]

Synthetic benchmarks may / may not be so kind but the combination of new hardware and virtualization has improved power efficiency by orders of magnitude for our use case at least, and we do pay for power use in the form of how many 20a 120v circuits we have to buy with the data-center provider.

Where I am in Alaska is way above the national average. In Anchorage it is actually UNDER the national average for electricity costs. In winter when I have to have my truck plugged in 3 hours before I want to start it (at -20 and below) it goes up even more. There is one electricity COOP here and they exist to line the pockets of the investors. plus its not de-regulated so for folks on retirement or Social Security get absolutely no breaks.

[WrigleyVillain]

So I saw it mentioned that when VMs are allowed to enter a low power state or sleep then the host itself can as well...are there any other caveats or things to be aware of here?

[NKrader]

Remote desktop you say?



I love that I just log in from my phone wherever I am :-)

Program rocks!

[NKrader]

Changed from Arctic cooling to dynatron modded with noctua got both boards running the same exact setup

[NKrader]

Custom cables for file server are getting started! Woot!

[Ender17]

where is that from?

[WrigleyVillain]

Uh a doc on his phone?

[NKrader]

where is that from?

Uh a doc on his phone?

Yes? But maximum mods is doing the work.

Also, picked up one of these babies for my file server :-D so stoked

[voodooFX]

Last autumn, I built 3 servers for a study project. People might be interested in the hw configs.

Server number 1 (single socket):
Before building the faster server, this one served as a kind of testbed. The goal was to configure it for good I/O performance.
i7-3930K, 64GB, 32 x SSDs via 4 LSI controllers, Mellanox 40 Gbit/sec network adapter

Fast I/O needs parallelism, like cpu bound programs need multicore cpus (or gpu's, if the application fits to this hw approach)


Before settling on the Samsung SSDs, I tested approx. 12 different SSDs for my workload. A few of those can be seen here.


one of the major benefits of the 4 memory channels of the LGA-2011 socket. They allow decent read performance beyond any LGA-1155 cpu.
16.7 GB/sec


Combined workloads with a simultaneous load on the cpu and io subsystem proofed the value of watercooling. The stock and be quiet air coolers limited overall performance. Using a watercooler increased overall performance by 30% on the non-overclocked cpu.
1.3 mio iops with 20 ssd. cpu is limiting the io subsystem here.


For flexibility and to facilitate many reconfigurations, i used long sata cables. Optically not nice, but useful.
This picture was taken when the stock vent was still on. wprime and super pi aren't taxing the CPU as heavily as for instance ycrunch, so the benefit of watercooling might not be as big.


This server was used for the record runs in ycrunch on calculating pi for 25, 50 and 100 billion digits in the category "single socket systems"
http://www.xtremesystems.org/forums/...=1#post5153478


The other 2 servers had different design goals. One was build for peak io performance on 2 sockets, utilizing 2 x E5-2687W, 256 GB and 48 ssd's. The goal with the third server was to get 72 terabyte capacity under 150 watt on the plug outlet using one E3-1245v2


cheers,
Andy

I work in a supercumputing centre and I see a lot of crazy things, but this is still like :banana::banana::banana::banana:

[Nirvash]

Not exactly a server, but they are where I keep servers.

[Buckeye]

That's at your home Nirvash ?

There are nice clean looking racks, what are they ?

[Nirvash]

That is very much my home, they are HP racks, the logo is just cut off the top of the photos. They don't seem to have any model numbers on them, so I can't say exactly, I got both of them used without side panels for $120
Will probably post pictures with the doors open after doing so more cable management.

[Nirvash]

Did I forget to post stuff... maybe. Or maybe I was just tweaking stuff...

[Duh]

So much pr0nzzzz there

[kromosto]

Remote desktop you say?



I love that I just log in from my phone wherever I am :-)

Program rocks!

are these computers names? i will use this naming schema as well. do you have patented it?

[Kingcarcas]

You guys are making me really think i need a "server".........

[skycrane]

You guys are making me really think i need a "server".........

Thats how we get you over to the dark side....young padawan....

[NKrader]

are these computers names? i will use this naming schema as well. do you have patented it?

lol

i used it becuase it makes sense, they are two of the same exact peices of hardware powered by one psu.

i dont care who uses, and like i could really stop you if i wanted

[skycrane]

C6100 ive found more than a few of these on ebay and thought 3 is a nice round number to have, so i have one inbound for a late Dec delivery
so the question i have is does the OS see these as 4 different mobos, or 1 big one with 8 sockets?

how would i connect all 3 of them together? witha 24 port Gbit switch, or are these inifiniband?

it says they are dual Gbit nics on each node with 4 nodes per enclosure, but they are HPC nodes, so wouldnt that mean inifinband?

whats a mezanine card, and what are they used for?

would i be able to boot each rack off of one hdd, or does each node need its own? what bout when i get all 3 racks, can u boot all 3 from one hdd

ive got a ton more questions.. lol

[Buckeye]

They are separate machines (nodes) and not one big one.


Nice setup tho