Results 1 to 19 of 19

Thread: The farm is getting a UPS!

  1. #1
    Xtreme Cruncher
    Join Date
    Jun 2007
    Location
    SK, Canada
    Posts
    836

    The farm is getting a UPS!

    UPDATE: SEE POST# 17

    Well it's summer time again and that usually means lightning storms and power outages here on the prairies. I've run my WCG farm for years with nothing but cheap surge supressors and I've been lucky, only lost one PSU in that time due to power failures. But now that I have some serious money invested in hardware, it's time to protect it with a quality UPS. Since all my machines now run on 240 volts, it took some investigating but I think I finally found a UPS that will work with North American style split phase 240v and has enough firepower to handle the farm.

    Here she is stretched out on my workbench, a brand new HP R3000H 2700 watt 2U UPS bought for $200 on eBay ($1700 retail+tax and shipping here in Canada)!!!



    Measurements are 24"L x 17.5"w x 3.5"h. Heavy sucker too! Took me and the UPS driver to lug it off the truck...lol!



    A pic of the rear panel. It has 9 C13 outlets, the same kind of connection you find on PSU's. There's enough there to hook up my 6 rigs, the cooling system PSU and one LCD monitor with 1 outlet to spare. I estimate my farms power draw at 1500w so this UPS should give me about 12 minutes of runtime but I'll likely set it up to initiate OS shutdown after 1-2 minutes. If the power isn't back on after 1-2 minutes, it likey is going to be off for a while anyways. The power plug is a 20A twist-lock and there's also a 20A outlet on the right to run a power distribution unit, but I don't have a need for that.



    Now to integrate it into the farm!



    Please excuse the dirty floor! This is my garage, not my house...lol! My first thought was to just reinforce the top shelf and put it up there and set the monitor on top, but I would have had to add too much lumber which would just get in the way during maintenance and upgrades. So I built a sturdy floor stand out of 2x4's. The rear attaches to the wall studs and the front sits on it's own legs. There's also a couple cross braces to help support the UPS across the middle. I could have just put it on the floor but this way it's protected from water and I can still store stuff underneath.

    It's not connected yet, I'm still waiting for the C13/C14 jumper cables and a serial card from NCIX and of course no one in this hick town had a twist lock 20A receptacle so I had to special order one too. I'm still not 100% sure this thing will work properly with split-phase 240v but that's easy enough to figure out once it's powered on and charged up. I'll updated this thread in a week or so once I have the data.
    Last edited by fallwind; 07-01-2010 at 02:41 AM.
    i7 3970X @ 4500MHz 1.28v
    Asus Rampage IV Extreme
    4x4GB Corsair Dominator GT 2133MHz 9-11-10-27
    Gigabyte Windforce 7970 OC 3-way Crossfire
    Windows 7 Ultimate x64
    HK 3.0-MCP655-Phobya 400mm rad
    Corsair AX1200i
    Sandisk Exrtreme 240GB
    3x2TB WD Greens for storage
    TT Armor VA8003SWA





  2. #2
    Xtreme Cruncher
    Join Date
    Jun 2007
    Location
    SK, Canada
    Posts
    836
    Reserved....
    i7 3970X @ 4500MHz 1.28v
    Asus Rampage IV Extreme
    4x4GB Corsair Dominator GT 2133MHz 9-11-10-27
    Gigabyte Windforce 7970 OC 3-way Crossfire
    Windows 7 Ultimate x64
    HK 3.0-MCP655-Phobya 400mm rad
    Corsair AX1200i
    Sandisk Exrtreme 240GB
    3x2TB WD Greens for storage
    TT Armor VA8003SWA





  3. #3
    V3 Xeons coming soon!
    Join Date
    Nov 2005
    Location
    New Hampshire
    Posts
    36,363
    Did I ever tell you how much I love your farm?
    Nice score on the UPS..
    Crunch with us, the XS WCG team
    The XS WCG team needs your support.
    A good project with good goals.
    Come join us,get that warm fuzzy feeling that you've done something good for mankind.

    Quote Originally Posted by Frisch View Post
    If you have lost faith in humanity, then hold a newborn in your hands.

  4. #4
    Registered User
    Join Date
    Apr 2010
    Location
    New Zealand, Hawkes Bay
    Posts
    79
    Man that looks damn cool!
    Thanks=[Pulsar]=




  5. #5
    NooB MOD
    Join Date
    Jan 2006
    Location
    South Africa
    Posts
    5,799
    A bong cooled farm, damn you're Xtreme I LOVE it
    Xtreme SUPERCOMPUTER
    Nov 1 - Nov 8 Join Now!


    Quote Originally Posted by Jowy Atreides View Post
    Intel is about to get athlon'd
    Athlon64 3700+ KACAE 0605APAW @ 3455MHz 314x11 1.92v/Vapochill || Core 2 Duo E8500 Q807 @ 6060MHz 638x9.5 1.95v LN2 @ -120'c || Athlon64 FX-55 CABCE 0516WPMW @ 3916MHz 261x15 1.802v/LN2 @ -40c || DFI LP UT CFX3200-DR || DFI LP UT NF4 SLI-DR || DFI LP UT NF4 Ultra D || Sapphire X1950XT || 2x256MB Kingston HyperX BH-5 @ 290MHz 2-2-2-5 3.94v || 2x256MB G.Skill TCCD @ 350MHz 3-4-4-8 3.1v || 2x256MB Kingston HyperX BH-5 @ 294MHz 2-2-2-5 3.94v

  6. #6
    WCG Cruncher
    Join Date
    Jun 2008
    Location
    Grid Square EM58mh
    Posts
    957
    Nice setup. And nice workbench.

    Distributed Computing: Making the world a better place, one work-unit at a time.

    http://www.worldcommunitygrid.org/index.jsp

  7. #7
    Fanboy of Good Products
    Join Date
    Oct 2008
    Location
    FL
    Posts
    4,050
    too awesome!
    Cruncher #1: EVGA Z68 FTW | i7-2600k @ 4.5 | 6GB Ram
    Cruncher #2: Supermicro Dual-Socket | 2 x 6-core Opterons | 4GB Ram
    Cruncher #3: 8-core Xserve 1,1

    T400 for non-crunching



    "But don't think you'll run me over - It's, ah, planting season here in Texas... and the farm is growing..." -Otis11 on crunching WCG

  8. #8
    Xtreme Member
    Join Date
    Apr 2006
    Location
    United Corporate States of Neo-Feudal Amurika, Inc.
    Posts
    464
    "The farm is getting a UPS!"

    ...and all the farm animals lived happily ever after...


    Hey, wack set up there!!

    AUDIO-ASUS Xonar DX SPKR-audioengine 5 CASE-Cooler Master Stacker RC-810-SSN1 CPU-E8400 - Q815 @ 4 GHz @ 1.23V FANS-Noctua GPU-EVGA GTX 660/2GB HDD-Raptor 150 ADFD + WD1600YS HSF-Noctua NH-U12 LCD-NEC 20WMGX² @ 1680x1050 MOBO-abit IP35 Pro - BIOS 16 + bolt mod OS-XP Pro x64 PSU-XFX 750W Black Edition RAM-G.Skill PC2-8800 Pi 2x2GB @ 1,128 @ 1.92v TIM-Arctic Cooling MX-2 UPS-TRIPPLITE SU1000XLa + Noctua fan mod

  9. #9
    Nanoseconds from Permaban
    Join Date
    Mar 2008
    Location
    Del City, OK
    Posts
    2,859
    No need to put things like monitors on the UPS, just put it on surge. That way your UPS will last those few seconds longer.

  10. #10
    Xtreme Cruncher
    Join Date
    Jun 2007
    Location
    SK, Canada
    Posts
    836
    The monitor is turned off 99% of the time, I only turn it on once or twice a day to check in on things. Battery life really isn't a concern though. The UPS is there mainly to protect against brown outs and power "flickers" that we get during lightning storms. If the power goes out completely, the rigs will be programmed to shut down after a minute or 2. I'd need a backup generator to crunch through a power outage and even I'm not that xtreme...lol!
    i7 3970X @ 4500MHz 1.28v
    Asus Rampage IV Extreme
    4x4GB Corsair Dominator GT 2133MHz 9-11-10-27
    Gigabyte Windforce 7970 OC 3-way Crossfire
    Windows 7 Ultimate x64
    HK 3.0-MCP655-Phobya 400mm rad
    Corsair AX1200i
    Sandisk Exrtreme 240GB
    3x2TB WD Greens for storage
    TT Armor VA8003SWA





  11. #11
    Xtreme Mentor
    Join Date
    Apr 2004
    Location
    CT, USA!!!
    Posts
    2,821
    Sweet farm fallwind! Can we get a close up shot of the cooling. Looks very innovative

  12. #12
    Let's get to 100 Million PPD!
    Join Date
    Apr 2010
    Location
    Southern NH
    Posts
    67
    Quote Originally Posted by fallwind View Post
    Well it's summer time again and that usually means lightning storms and power outages here on the prairies. I've run my WCG farm for years with nothing but cheap surge supressors and I've been lucky, only lost one PSU in that time due to power failures. But now that I have some serious money invested in hardware, it's time to protect it with a quality UPS. Since all my machines now run on 240 volts, it took some investigating but I think I finally found a UPS that will work with North American style split phase 240v and has enough firepower to handle the farm.

    Here she is stretched out on my workbench, a brand new HP R3000H 2700 watt 2U UPS bought for $200 on eBay ($1700 retail+tax and shipping here in Canada)!!!



    Measurements are 24"L x 17.5"w x 3.5"h. Heavy sucker too! Took me and the UPS driver to lug it off the truck...lol!



    A pic of the rear panel. It has 9 C13 outlets, the same kind of connection you find on PSU's. There's enough there to hook up my 6 rigs, the cooling system PSU and one LCD monitor with 1 outlet to spare. I estimate my farms power draw at 1500w so this UPS should give me about 12 minutes of runtime but I'll likely set it up to initiate OS shutdown after 1-2 minutes. If the power isn't back on after 1-2 minutes, it likey is going to be off for a while anyways. The power plug is a 20A twist-lock and there's also a 20A outlet on the right to run a power distribution unit, but I don't have a need for that.



    Now to integrate it into the farm!



    Please excuse the dirty floor! This is my garage, not my house...lol! My first thought was to just reinforce the top shelf and put it up there and set the monitor on top, but I would have had to add too much lumber which would just get in the way during maintenance and upgrades. So I built a sturdy floor stand out of 2x4's. The rear attaches to the wall studs and the front sits on it's own legs. There's also a couple cross braces to help support the UPS across the middle. I could have just put it on the floor but this way it's protected from water and I can still store stuff underneath.

    It's not connected yet, I'm still waiting for the C13/C14 jumper cables and a serial card from NCIX and of course no one in this hick town had a twist lock 20A receptacle so I had to special order one too. I'm still not 100% sure this thing will work properly with split-phase 240v but that's easy enough to figure out once it's powered on and charged up. I'll updated this thread in a week or so once I have the data.
    Dirty Floor!! OMG that is the neatest worktable I've seen, and we have a few PCs running here. Upstairs/downstairs, there are parts everywhere. nag, nag, nag.
    in my house.

  13. #13
    Xtreme Enthusiast
    Join Date
    Mar 2008
    Location
    Pittsburgh, PA
    Posts
    567
    That is sweet. I'm in awe actually.
    SOGOs > BOGOs

  14. #14
    V3 Xeons coming soon!
    Join Date
    Nov 2005
    Location
    New Hampshire
    Posts
    36,363
    Quote Originally Posted by fallwind View Post
    The monitor is turned off 99% of the time, I only turn it on once or twice a day to check in on things. Battery life really isn't a concern though. The UPS is there mainly to protect against brown outs and power "flickers" that we get during lightning storms. If the power goes out completely, the rigs will be programmed to shut down after a minute or 2. I'd need a backup generator to crunch through a power outage and even I'm not that xtreme...lol!
    My 5500w generator is in the garage and ready to go..
    Gives app 30 amps, enough to run the house on a light load and keep a couple PC's running..
    Crunch with us, the XS WCG team
    The XS WCG team needs your support.
    A good project with good goals.
    Come join us,get that warm fuzzy feeling that you've done something good for mankind.

    Quote Originally Posted by Frisch View Post
    If you have lost faith in humanity, then hold a newborn in your hands.

  15. #15
    Xtreme Cruncher
    Join Date
    Dec 2004
    Location
    South Carolina
    Posts
    631
    Sweet score Fallwind, congrats and that is one mean farm
    Samsung 42" LCD/Antec 1200 Case/Corsair 1000W PS/ Gigabyte GA-X58A-UD7 / Intel I7 990X 3.47 @ 4.5 / 3 x RX360 rad /Apogee Xt /2 x 128gb Patriot Torqx M28's @ Raid 0/ WD 600Gb VelociRaptor / Kingston Hyper X 12Gb (6x2) DDR3 2000/ XFX DD HD 7970


  16. #16
    Xtreme Cruncher
    Join Date
    Jun 2007
    Location
    SK, Canada
    Posts
    836
    Quote Originally Posted by =[PULSAR]= View Post
    Sweet farm fallwind! Can we get a close up shot of the cooling. Looks very innovative
    These pics are from about a year ago, different PC hardware but cooling equipment remains the same.

    Here's a closeup of one of the return lines to the pipe that carries water back up to the radiator. The pipe is just plain 1.5" ABS drain pipe and the 1/2" ABS hose adapter is known as a "dishwasher adapter". If you have a dishwasher, you'll have one of these under your sink, the 1/2" fitting will point up though.



    This is the right side of the shelf showing the cold water pipe and the connection to one of the MCP-655 pumps. Again, nothing fancy, just more ABS pipe and standard PC cooling gear. From here the tubing just leapfrogs across 3 waterblocks to the return pipe on the left side pictured above. You can also see my old 120v outlet. I've since installed another outlet to the left of this one that carries 240v which helps improve PSU efficiency. The coolant looks orange because I used to use a 90/10 mix of distilled/antifreeze for biocide. I've since switched to pure distilled and silver for biocide. The entire system holds about 2 gallons of water. Another nice feature is the ease of system bleeding. I just fill it up, turn on the pumps and it's bled of air in about 5 seconds....lol!



    A little blurry but this is a threaded end cap on the bottom of each ABS pipe. To drain the entire loop, I just place a bucket underneath and spin off the caps.



    Here's one of the connections to the radiator. I pieced together some fittings at the hardware store to turn the 1.5" ABS into a 1.25" barbed hose fitting and then spliced it to the rad with some radiator hose.




    The radiator is out of a 1988 Nissan Maxima, got it from a local rad shop used for $50. Took an afternoon to clean it inside and out but otherwise it was in good shape. The trick to using a car rad is finding an older one made out of brass and copper since newer rads usually have an aluminum core. The fans are overkill but I run them off the 3.3v rail on the PSU so they're fairly quiet and only draw about 20w at that speed.

    i7 3970X @ 4500MHz 1.28v
    Asus Rampage IV Extreme
    4x4GB Corsair Dominator GT 2133MHz 9-11-10-27
    Gigabyte Windforce 7970 OC 3-way Crossfire
    Windows 7 Ultimate x64
    HK 3.0-MCP655-Phobya 400mm rad
    Corsair AX1200i
    Sandisk Exrtreme 240GB
    3x2TB WD Greens for storage
    TT Armor VA8003SWA





  17. #17
    Xtreme Cruncher
    Join Date
    Jun 2007
    Location
    SK, Canada
    Posts
    836
    Update time!!! The UPS is wired up and working perfectly! It took some time to get it configured correctly and figure a few things out but this server grade stuff is really sweet to work with once it's running! My biggest fear was that the batteries would be shot because the UPS was over a year past it's next recharge date but they charged up fine and I did a 4 minute battery test with a 1400w power draw and it held up fine with 50% battery capacity left at the end, which matched up nicely with it's predicted runtime of 9 min. See the screen shots below of the management software.

    All that's left now it to track down an SNMP card. This gives the UPS access to my LAN and allows it to send signals to the attached rigs to shut down gracefully in the event of a power failure.



    Check out the total output power!! 1432 watts for 3 Gulftowns at 4.2, 3 920's at 4.0, 2 pumps, 19" LCD, 2 massive rad fans, network switch, etc. When I shut the LCD off it actually drops below 1400w. I know the entire cooling system draws about 100w so 1300w or 217w/rig including PSU losses is pretty impressive.



    i7 3970X @ 4500MHz 1.28v
    Asus Rampage IV Extreme
    4x4GB Corsair Dominator GT 2133MHz 9-11-10-27
    Gigabyte Windforce 7970 OC 3-way Crossfire
    Windows 7 Ultimate x64
    HK 3.0-MCP655-Phobya 400mm rad
    Corsair AX1200i
    Sandisk Exrtreme 240GB
    3x2TB WD Greens for storage
    TT Armor VA8003SWA





  18. #18
    version 2.0
    Join Date
    Feb 2005
    Location
    Flanders
    Posts
    3,862
    that is very little electric for your output

    must be the one of the most efficient farms

  19. #19
    Xtreme Cruncher
    Join Date
    Jun 2007
    Location
    SK, Canada
    Posts
    836
    The farm is in my garage and does about 280-290k PPD, the rest of my output (110k PPD) comes from me and the wifes rig in my house.
    Last edited by fallwind; 07-01-2010 at 03:24 AM.
    i7 3970X @ 4500MHz 1.28v
    Asus Rampage IV Extreme
    4x4GB Corsair Dominator GT 2133MHz 9-11-10-27
    Gigabyte Windforce 7970 OC 3-way Crossfire
    Windows 7 Ultimate x64
    HK 3.0-MCP655-Phobya 400mm rad
    Corsair AX1200i
    Sandisk Exrtreme 240GB
    3x2TB WD Greens for storage
    TT Armor VA8003SWA





Bookmarks

Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •