+ Reply to Thread
Page 1 of 2 1 2 LastLast
Results 1 to 25 of 27

Thread: New 'single validation' of DDDT

  1. #1
    Xtreme Cruncher [XC] Adywebb's Avatar
    Join Date
    Aug 2006
    Location
    UK
    Posts
    835
    Thanks
    0
    Thanked 0 Times in 0 Posts

    New 'single validation' of DDDT

    Apparently within the next week or so WCG will start beta testing new 'single validation' DDDT WU's.

    They have not yet announced yet how these new units will be issued credit, but if they only need one computation to validate and no quorum I'm wondering if this will mean you will get what you claim, or if they will have some kind of fixed credit

    Anyway, watch this space........
    DC Prostitute - Crunching In Memory of My Dad

  2. #2
    Registered User
    Join Date
    Jun 2006
    Posts
    53
    Thanks
    0
    Thanked 0 Times in 0 Posts
    That sounds awesome, that'll save so much CPU power!

  3. #3
    I am Xtreme
    Join Date
    Sep 2007
    Location
    New Jersey, U.S.
    Posts
    2,334
    Thanks
    0
    Thanked 0 Times in 0 Posts
    Thanks for the update - I haven't been checking the forums very often.

  4. #4
    Xtreme Member Hymay's Avatar
    Join Date
    May 2006
    Location
    North Idaho
    Posts
    280
    Thanks
    1
    Thanked 0 Times in 0 Posts
    I may have to set my amd to do do ddt exclusively then. For some reason it either overclaims, or I get paired with really badly benched machines. It virtually never gets its claim or higher... and gets "skunked" (30% rule crap with quorum of 2) pretty frequently. I think I've gotten over my claim twice since I got it running.
    Downloaded the client directly from WCG.. so I know its not using leftover optimized files from the old days.
    Fairly irritating.. but I just couldnt' stand having an all intel stable.

  5. #5
    Xtreme Cruncher anubis's Avatar
    Join Date
    Feb 2003
    Location
    Estonia
    Posts
    916
    Thanks
    13
    Thanked 5 Times in 5 Posts
    me thinks they send both units to one computer..one pc quorum
    Member of XS WCG since 2006-11-25



  6. #6
    Xtreme Cruncher [XC] Adywebb's Avatar
    Join Date
    Aug 2006
    Location
    UK
    Posts
    835
    Thanks
    0
    Thanked 0 Times in 0 Posts
    Quote Originally Posted by anubis View Post
    me thinks they send both units to one computer..one pc quorum
    I doubt that very much - they might as well continue having 2 unit quorum validation in that case.
    DC Prostitute - Crunching In Memory of My Dad

  7. #7
    Xtreme Legend DDTUNG's Avatar
    Join Date
    Jun 2002
    Location
    Hong Kong
    Posts
    3,552
    Thanks
    0
    Thanked 0 Times in 0 Posts
    Please keep us closely posted on this development. It would be nice if my quad farm could start getting what it claims for work done.

    DDTUNG
    XtremeSystems - we overclock and crunch you to the ground


    I left the optimized files on three 3GHz P4 HTs. Ban me.

  8. #8
    Xtreme Cruncher anubis's Avatar
    Join Date
    Feb 2003
    Location
    Estonia
    Posts
    916
    Thanks
    13
    Thanked 5 Times in 5 Posts
    Quote Originally Posted by [XC] Adywebb View Post
    I doubt that very much - they might as well continue having 2 unit quorum validation in that case.
    but why would it be a bad idea? if the outcomes differ they can just send it to someone else. but youd get your points worth if the results match.
    Member of XS WCG since 2006-11-25



  9. #9
    Administrator sierra_bound's Avatar
    Join Date
    Dec 2003
    Location
    Northern California
    Posts
    204,163
    Thanks
    0
    Thanked 36 Times in 17 Posts
    They are probably going to send out just one work unit, with no duplicates. The Dengue project is supposed to run for another six months or so. I think the scientitsts just want to process as many WU's as possible during that time span.
    Audentes fortuna iuvat

    "Fortune favors the bold"

  10. #10
    Xtreme Cruncher [XC] Adywebb's Avatar
    Join Date
    Aug 2006
    Location
    UK
    Posts
    835
    Thanks
    0
    Thanked 0 Times in 0 Posts
    Quote Originally Posted by anubis View Post
    but why would it be a bad idea? if the outcomes differ they can just send it to someone else. but youd get your points worth if the results match.
    The idea of single validation is they only need to send out 1 unit for computation - if they still send out 2 even if its to the same computer then it defeats the object of the excercise.

    Also if that PC is throwing up errors, aborts, doesn't crunch them in time etc, then they will have to send out another 2 to another computer - so they've now sent 4
    DC Prostitute - Crunching In Memory of My Dad

  11. #11
    Xtreme Cruncher anubis's Avatar
    Join Date
    Feb 2003
    Location
    Estonia
    Posts
    916
    Thanks
    13
    Thanked 5 Times in 5 Posts
    but if they only send out 1 wu then how do they know it errored? sorry if its a stupid question
    Member of XS WCG since 2006-11-25



  12. #12
    Administrator sierra_bound's Avatar
    Join Date
    Dec 2003
    Location
    Northern California
    Posts
    204,163
    Thanks
    0
    Thanked 36 Times in 17 Posts
    I'm not sure what you mean by "error". If there is a computational error, the result will be thrown out anyway and you would receive no credit. On any result that looks medically promising, the researchers will probably re-run it again themselves for verification purposes.
    Audentes fortuna iuvat

    "Fortune favors the bold"

  13. #13
    Xtreme Member Hymay's Avatar
    Join Date
    May 2006
    Location
    North Idaho
    Posts
    280
    Thanks
    1
    Thanked 0 Times in 0 Posts
    Any new word on these, or an ETA when they will start hitting?

  14. #14
    Xtreme Cruncher [XC] Adywebb's Avatar
    Join Date
    Aug 2006
    Location
    UK
    Posts
    835
    Thanks
    0
    Thanked 0 Times in 0 Posts
    Nothing more - they still haven't yet announced the start of the Beta testing.
    DC Prostitute - Crunching In Memory of My Dad

  15. #15
    Xtreme Cruncher fallwind's Avatar
    Join Date
    Jun 2007
    Location
    SK, Canada
    Posts
    825
    Thanks
    1
    Thanked 9 Times in 5 Posts
    Just a quick post to say that these new WU's are now going out. I have a few crunching right now.
    i7 3970X @ 4500MHz 1.28v
    Asus Rampage IV Extreme
    4x4GB Corsair Dominator GT 2133MHz 9-11-10-27
    Gigabyte Windforce 7970 OC 3-way Crossfire
    Windows 7 Ultimate x64
    HK 3.0-MCP655-Phobya 400mm rad
    Corsair AX1200i
    Sandisk Exrtreme 240GB
    3x2TB WD Greens for storage
    TT Armor VA8003SWA





  16. #16
    Xtreme crazy bastid D_A's Avatar
    Join Date
    Apr 2007
    Location
    In the middle of an Auz fire zone.
    Posts
    5,444
    Thanks
    0
    Thanked 60 Times in 46 Posts
    How long do these run and on what hardware?


  17. #17
    Xtreme Addict Naja002's Avatar
    Join Date
    Jul 2006
    Location
    Usa
    Posts
    1,164
    Thanks
    1
    Thanked 0 Times in 0 Posts
    How can we tell the difference?

  18. #18
    Xtreme Cruncher fallwind's Avatar
    Join Date
    Jun 2007
    Location
    SK, Canada
    Posts
    825
    Thanks
    1
    Thanked 9 Times in 5 Posts
    Looks like 2.5-3.25hrs on my QX9650@4GHz, so their reasonable length. DDDT hasn't had any work sent out in quite a while so anything you have now will be the new single validation units. But if you want to check, go to my grid>>results status and filter the results for DDDT. Then click on the WU names to see if you're the only one in the quorum.

    I'm interested too see how points are awarded. If it simply awards what you claim it would be great since my x64 machines get slaughtered in the quorum in all projects.
    i7 3970X @ 4500MHz 1.28v
    Asus Rampage IV Extreme
    4x4GB Corsair Dominator GT 2133MHz 9-11-10-27
    Gigabyte Windforce 7970 OC 3-way Crossfire
    Windows 7 Ultimate x64
    HK 3.0-MCP655-Phobya 400mm rad
    Corsair AX1200i
    Sandisk Exrtreme 240GB
    3x2TB WD Greens for storage
    TT Armor VA8003SWA





  19. #19
    Xtreme Cruncher fallwind's Avatar
    Join Date
    Jun 2007
    Location
    SK, Canada
    Posts
    825
    Thanks
    1
    Thanked 9 Times in 5 Posts
    Get a load of this! I'm the only one in the quorum, so I have no idea how they are calculating claimed vs awarded points.
    Attached Images  
    i7 3970X @ 4500MHz 1.28v
    Asus Rampage IV Extreme
    4x4GB Corsair Dominator GT 2133MHz 9-11-10-27
    Gigabyte Windforce 7970 OC 3-way Crossfire
    Windows 7 Ultimate x64
    HK 3.0-MCP655-Phobya 400mm rad
    Corsair AX1200i
    Sandisk Exrtreme 240GB
    3x2TB WD Greens for storage
    TT Armor VA8003SWA





  20. #20
    Xtreme Cruncher [XC] Adywebb's Avatar
    Join Date
    Aug 2006
    Location
    UK
    Posts
    835
    Thanks
    0
    Thanked 0 Times in 0 Posts
    This is an explanation about how single validation works from one of the Techs at WCG:
    Quote Originally Posted by WCG Tech
    Single validation is going to work in the following way:

    Workunits are loaded into BOINC with a quorum size of 1. This means that 1 replica is created and it will only take 1 successfully run result in order for validation to be attempted on the result.

    However, there are a few checks in place:

    1) The server maintains a value that serves to inform us of how 'reliable' a given computer is. When a result is assigned to the computer for a workunit with a quorum of 1, then the reliable measurement is checked to make sure that the computer is sufficiently reliable. If it is, then all is good. If it isn't, then the workunit is changed to have a min_quorum of two and a second copy is sent.

    2) When validation is attempted, the value for the host is checked again. If the value has fallen below the required level, then the result is marked INCONCLUSIVE and another result is sent.

    3) Additionally, during validation, there is a certain random chance that the result will be flagged to be checked again. Any result picked in this case will be marked INCONCLUSIVE until the validation with the additional result occurs. All computers are subject to random checking.

    4) We have also added some additional checks within the research apps to detect errant results. Part of this is a short run of the application that computes a known result (this was part of what we ran last week). This short run will be used to help ensure that the computation ran correctly as well as it will be used to determine the appropriate credit to award.
    Point 4 is the only place where it refers to credit allocation - its not very clear to me, however I am guessing they do a short run of WU's themselves to get some kind of average speed for computation and credit claim and then look at the efficiency of your machines and award granted credit according to some formula or other

    That's the best I can come up with at the moment I'm afraid...
    DC Prostitute - Crunching In Memory of My Dad

  21. #21
    version 2.0 Jaco's Avatar
    Join Date
    Feb 2005
    Location
    Flanders
    Posts
    3,856
    Thanks
    5
    Thanked 2 Times in 2 Posts
    I don't understand it. What is the reliable measurement ?

    How is the reliability of computer checked?
    Is there a small test at the beginning of each WU or are they keeping a database about how reliable your machine is (based on previous results) ?

  22. #22
    Xtreme crazy bastid D_A's Avatar
    Join Date
    Apr 2007
    Location
    In the middle of an Auz fire zone.
    Posts
    5,444
    Thanks
    0
    Thanked 60 Times in 46 Posts
    That sounds like it might be the case. The latter thing that is.


  23. #23
    Xtreme Cruncher
    Join Date
    Mar 2006
    Location
    Netherlands
    Posts
    304
    Thanks
    0
    Thanked 0 Times in 0 Posts

    Question

    Well the new units are giving me a hard time allready have like 6 inconclusives and some that are valid. And indeed is see that another unit is send out now that mine is inconclusive.

    Hope it has something to do with the wu's because all other wu's are acting normal on my machines.

  24. #24
    Xtreme Cruncher [XC] Adywebb's Avatar
    Join Date
    Aug 2006
    Location
    UK
    Posts
    835
    Thanks
    0
    Thanked 0 Times in 0 Posts
    Quote Originally Posted by [XC] Jaco View Post
    I don't understand it. What is the reliable measurement ?

    How is the reliability of computer checked?
    Is there a small test at the beginning of each WU or are they keeping a database about how reliable your machine is (based on previous results) ?
    I've asked the question over at WCG - so far 2 conflicting replies from CA's, so awaiting for a more definative answer from a Tech....however I think these are probably near the mark:

    Quote Originally Posted by Sekerob
    There is a little benchmark right at the beginning of a job, every job, that computes a known piece of science. That and the variation for each DDDT benchmark is used to build a claim rating for a device forming part of the computation of credit. Let me dig out if anything was written over what was said in point 4.

    I've not done new DDDT yet, so cant say from hands on, but one CA achieved a claim to grant variation between 0 and 4.3%

    The workings for the new FAAH will be the same. I just know from the 43 beta I got of last test, the difference was minimal.
    And an update:

    Quote Originally Posted by Sekerob
    As what i wrote earlier it's definitely hinging on that little pre-job integrated benchmark of a reference piece of DDDT science. Do that well, you get equal or more than the claim.... do it not so well, you get a little less. Over time it's expected to converge, so at least the data from the beta test supported the theory.
    DC Prostitute - Crunching In Memory of My Dad

  25. #25
    version 2.0 Jaco's Avatar
    Join Date
    Feb 2005
    Location
    Flanders
    Posts
    3,856
    Thanks
    5
    Thanked 2 Times in 2 Posts
    pre-job integrated benchmark.
    That's for crediting purposes, i would think

    That 'reliable measurement' still confuses me .

+ Reply to Thread
Page 1 of 2 1 2 LastLast

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts