Results 1 to 10 of 10

Thread: CEP2. How much memory really?

  1. #1
    Xtreme Legend
    Join Date
    Mar 2008
    Location
    Plymouth (UK)
    Posts
    5,285

    CEP2. How much memory really?

    I have always been cautious about running too many Clean Energy threads at once but as there seems to be little else to run I decided to take a look at memory use.....

    Linux Mint 64 Cinnamon here and the System monitor is showing 31 threads using 5.7GB. ???

    I thought that it is supposed to need a GB per thread??? It still says that on: https://secure.worldcommunitygrid.or...ame=minimumreq

    Anyone got any input on this? Does it use more as the wu's progress? (currently I have progress between 9 and 69%)


    My Biggest Fear Is When I die, My Wife Sells All My Stuff For What I Told Her I Paid For It.
    79 SB threads and 32 IB Threads across 4 rigs 111 threads Crunching!!

  2. #2
    Xtreme Cruncher
    Join Date
    Feb 2003
    Location
    Estonia
    Posts
    1,098
    Im waiting for my queue of 40 DSFL WUs to finish. If this is really true then
    Member of XS WCG since 2006-11-25




  3. #3
    Xtreme Addict Evantaur's Avatar
    Join Date
    Jul 2011
    Location
    Finland
    Posts
    1,040
    i believe 1GB is the worst case scenario

    I like large posteriors and I cannot prevaricate

  4. #4
    Xtreme Cruncher
    Join Date
    Feb 2003
    Location
    Estonia
    Posts
    1,098
    When i was running win7x64 it used everything with my 12c 6gb system and swapped as hell, almost killed SSD, that i know.
    Member of XS WCG since 2006-11-25




  5. #5
    Xtreme Cruncher
    Join Date
    Jun 2007
    Location
    SK, Canada
    Posts
    835
    Mem usage is highly variable with CEP2 and 1GB per thread is recommended. You'll also need a descent SSD (or RAM drive) dedicated to the BOINC data folder if you plan to run more than 4 or 5 threads at a time. This is from my experience with Windows machines, YMMV with Linux.

    I had one of my 12 thread rigs set up with 24GB of RAM, half dedicated to system memory and the other half to a RAM drive containing the BOINC data folder. It crunched 12 threads of CEP2 no problem but as with any windows machine, it would occasionally lock up or crash and I'd have to re-install BOINC.
    i7 3970X @ 4500MHz 1.28v
    Asus Rampage IV Extreme
    4x4GB Corsair Dominator GT 2133MHz 9-11-10-27
    Gigabyte Windforce 7970 OC 3-way Crossfire
    Windows 7 Ultimate x64
    HK 3.0-MCP655-Phobya 400mm rad
    Corsair AX1200i
    Sandisk Exrtreme 240GB
    3x2TB WD Greens for storage
    TT Armor VA8003SWA





  6. #6
    Xtreme crazy bastid
    Join Date
    Apr 2007
    Location
    On mah murder-sickle!
    Posts
    5,881
    I found it was similar on my Linux machines. Very memory hungry and insanely swappy. Not system swap though, directly to the BOINC data folder. There was quite a bit of talk on the WCG forums about setting up RAM drives on Linux for it but I didn't pay too much attention as I didn't have the RAM to do it.

    [SIGPIC][/SIGPIC]

  7. #7
    Xtreme Addict Evantaur's Avatar
    Join Date
    Jul 2011
    Location
    Finland
    Posts
    1,040
    I had one of my 12 thread rigs set up with 24GB of RAM, half dedicated to system memory and the other half to a RAM drive containing the BOINC data folder. It crunched 12 threads of CEP2 no problem but as with any windows machine, it would occasionally lock up or crash and I'd have to re-install BOINC.
    You only need to ramdrive your slots directory, that's where all those heavy writes are happening

    I like large posteriors and I cannot prevaricate

  8. #8
    HWiNFO Author
    Join Date
    Apr 2006
    Location
    /dev/null
    Posts
    801
    I just checked the memory usage on W7 x64 and it varies between 100-250 MB per CEP2 thread, peak usage was 310 MB.
    I'm not sure if a RAM drive can improve disk access, since when there's free memory, Windows uses it for file buffers anyway.

  9. #9
    Xtreme crazy bastid
    Join Date
    Apr 2007
    Location
    On mah murder-sickle!
    Posts
    5,881
    CEP2 doesn't behave like you'd expect. It's not the amount of RAM each unit requires that's the problem, it's the amount of data it caches during the course of the unit. CEP2 is known to write substantial amounts of data to it's own work directories during the course of each unit. This is unaffected by any settings for swap or page file usage since it has nothing to do with either. By the way, by "substantial" I mean up to 24GB per unit. When running more than a couple of units at a time it can severely lag the IO system with the hard drive being the major bottleneck. The project has been known to eat early SSDs due to the volume of writes to storage. Running it with the data directory on a good SSD was found to make a substantial improvement in efficiency and running in a RAM drive better again, significantly more so that with any other WCG project.

    [SIGPIC][/SIGPIC]

  10. #10
    Xtreme Member
    Join Date
    Jun 2010
    Location
    Crab Nebula
    Posts
    493
    Each CEP2 task can read/write as much as 32GB of data. That's why I personally do not use SSDs when running it. Raising the "write to disk every xx seconds" in BOINC settings can help reduce the strain but it will take longer for the task to complete. Default is 60 seconds. I use 300 for CEP2.



    You'll never know what you're living for until you know what you're willing to die for.

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •