Join PrimeGrid
Returning Participants
Community
Leader Boards
Results
Other
drummers-lowrise
|
Message boards :
The Riesel Problem :
Reducing TRP-Sieve deadline to 3 days, or increase everything to 4 days?
Author |
Message |
Michael Goetz Volunteer moderator Project administrator
 Send message
Joined: 21 Jan 10 Posts: 13513 ID: 53948 Credit: 237,712,514 RAC: 0
                           
|
We're going to reduce the deadline for TRP-Sieve tasks to three days. Currently it's 4 days, despite these being very short tasks.
The deadline was longer than the 3 days we typically use for short tasks to accommodate the slow processors used on Android devices, since we used to have an Android app. Since that's no longer a factor, there doesn't seem to be a reason to keep the deadline at 4 days.
Unless someone has a good reason we haven't considered, we'll be reducing the deadline to 3 days in the near future.
____________
My lucky number is 75898524288+1 | |
|
|
I really think that leaving the deadline at 4 days will almost require me and others to stop doing these tasks since Sophie tasks always run first so I have to wait until almost the 3rd day to run these. Either that the scheduler will not send out as many tasks and I will run out of them so fast that I won't be able to get new ones. Please at least watch how many abort due to deadline because I believe you will see a big increase in this if the deadline is shorter.
| |
|
GDBSend message
Joined: 15 Nov 11 Posts: 240 ID: 119185 Credit: 2,577,314,587 RAC: 0
                   
|
Saying Sophia tasks always run first may be true only if you don't use an app_config file. With an app_config file, you can always allow TRP to run immediately. | |
|
|
Following your theory, why don't you reduce the deadline to 1 day ?
The question is not the task duration but the availability of computers for this particular application. The shorter is the task, the higher is the number of WU received so the total workload received in one batch remains the same. Reducing the deadline of short tasks is a nonsense : it only makes participants' work very difficult, as they should drastically reduce the work buffer size used by the BOINC application for ALL projects and select computer by computer the PrimeGrid subprojects to be run if they want to complete the WUs in time.
Other point : I don't know how long is the week-end break in your country, but in mine, it's around 60 hours, so it will be very difficult to complete a 3-day (72h) deadline.
You must consider that a lot of computers running BOINC don't work 24/7 and aren't 100 % available for an unique subproject. | |
|
Michael Goetz Volunteer moderator Project administrator
 Send message
Joined: 21 Jan 10 Posts: 13513 ID: 53948 Credit: 237,712,514 RAC: 0
                           
|
I really think that leaving the deadline at 4 days will almost require me and others to stop doing these tasks since Sophie tasks always run first so I have to wait until almost the 3rd day to run these. Either that the scheduler will not send out as many tasks and I will run out of them so fast that I won't be able to get new ones. Please at least watch how many abort due to deadline because I believe you will see a big increase in this if the deadline is shorter.
If you are keeping a large cache of tasks on your computer (i.e., more than one day's worth of work), it may be that BOINC will do a better job of scheduling tasks with a shorter queue. I personally run with ZERO queue, which not only means BOINC usually has to run tasks in the correct order, but it also increases the probability of you being the prime finder rather than the double checker.
____________
My lucky number is 75898524288+1 | |
|
Michael Goetz Volunteer moderator Project administrator
 Send message
Joined: 21 Jan 10 Posts: 13513 ID: 53948 Credit: 237,712,514 RAC: 0
                           
|
Why don't you reduce it to 1 day ?
It's hard to tell, but assuming that wasn't sarcasm, I'll answer the question directly: I don't want deadlines less than three days because there are some slow computers out there and I want them to be able to some something at PrimeGrid. I won't configure PrimeGrid so you have enough time to run SoB tasks on an Atom or a P90, but I do want them to be able to at least run the shorter tasks.
Also, there are computers that either don't have continuous access to the Internet or aren't turned on 24/7. Three days gives them a little leeway.
Other point : I don't know how long the week-end break is in your country. In mine, it's around 60 hours, so it will be very difficult to complete a 3-day deadline. You must consider that a lot of computers running BOINC don't work 24/7 and aren't 100 % available for an unique subproject.
Which is exactly why the minimum deadline is 3 days instead of 1.
No matter how it's set up, there's always going to be people that it's just not going to work for. I try to set things up so it's works for as many people as possible.
____________
My lucky number is 75898524288+1 | |
|
|
I agree that the 1-day idea is a little sarcastic, but running your project gives headaches.
Please have a look on the participants' point of view : I really think that you misunderstand the way BOINC application works on THEIR computers.
Suppose that I have a 1 day buffer and 2 cores active. I will roughly receive WUs for a total of 48h workload. If the WU duration is 2 hours, I will receive 24 WUs. If it's only 1 hour, I will receive 48 WUs. As the 48 new WUs will complete in the same time than the 24 old WUs, there is absolutely no reason to reduce the deadline.
Reducing the deadline as you do in your project has an unique effect : force all WUs to run in high priority, with the risk of not completing in time. May be it's your goal, but let me tell you that this is a nonsense in a time-sharing environment! | |
|
Neo Volunteer tester
 Send message
Joined: 28 Oct 10 Posts: 710 ID: 71509 Credit: 91,178,992 RAC: 0
                   
|
If you don't have a dedicated crunching machine that works 24/7, you really should take Michael's advice and set your BOINC work cache from .2 days to 0.
IF you have a dedicated crunching machine that works 24/7, you really should take Michael's advice and set your BOINC work cache from .2 days to 0. (Scott Brown - are you reading this?)
Reducing the deadline from 4 to 3 days is no big deal, albeit, I'm not sure why this is being done, but I really don't care... If I crunch a TRP sieve, it's done in under 1 hour and the w/u returned.
I never ever have a w/u waiting to be crunched.... Once I'm done with a w/u it's sent to Primegrid and then a new w/u is downloaded.
"If you're not first, you're last" - Talladega Nights
Neo
AtP
____________
| |
|
Michael Goetz Volunteer moderator Project administrator
 Send message
Joined: 21 Jan 10 Posts: 13513 ID: 53948 Credit: 237,712,514 RAC: 0
                           
|
I agree that the 1-day idea is a little sarcastic, but running your project gives headaches. Please have a look on the participants' point of view : I really think that you misunderstand the way BOINC application works on THEIR computers.
Fair enough. Are you willing to describe how you use your computers?
- How often they're turned on?
- How frequently BOINC computing is enabled?
- Is there a pattern as to when the computers are turned on, such as "only evenings and weekends"?
- Which projects you're running (i.e., PrimeGrid, SETI, etc.)?
- If more than one project, what's the relative weights ("resource share") that you've assigned to each project?
- Which PrimeGrid sub-projects you're running?
- The size of your job cache (your settings for "Minimum work buffer" and "Max additional work buffer")?
We don't have a lot of people who crunch on their computers only part-time -- or at least not a lot who also post on the forums. It would be helpful to understand the use case of how such computers are operated.
One final question:
If you were making the decisions, how long would you make the deadlines, and why?
____________
My lucky number is 75898524288+1
| |
|
|
Side question;
Will there be android Work Units again?[/b]
____________
| |
|
|
One final question:
If you were making the decisions, how long would you make the deadlines, and why?
4 days minimum for the short tasks, it allows for three-day weekends. Prime-finding is not a time critical endeavor, demanding quick turn around just seems foolish. I am of the opinion that any project that needs quick turn around should not be using volunteer distributed computing, rather they should acquire dedicated computers. Boinc projects in the open environment should be casual.
Many crunchers run multiple projects, short deadlines over-taxes the feeble mindedness of the Boinc scheduler. Not all projects work well with a 0.0 queue, that is their servers are not nearly as robust as the PG servers so fewer server requests is better.
(The decision seems arbitrary.)
____________
Werinbert is not prime... or PRPnet keeps telling me so.
Badge score: 1x1 + 12x3 + 1x4 + 1x5 + 1x6 + 2x7 + 1x8 + 1x10 = 84 | |
|
axnVolunteer developer Send message
Joined: 29 Dec 07 Posts: 285 ID: 16874 Credit: 28,027,106 RAC: 0
            
|
Suppose that I have a 1 day buffer and 2 cores active. I will roughly receive WUs for a total of 48h workload. If the WU duration is 2 hours, I will receive 24 WUs. If it's only 1 hour, I will receive 48 WUs. As the 48 new WUs will complete in the same time than the 24 old WUs, there is absolutely no reason to reduce the deadline.
BOINC doesn't calculate how many WU to download based on deadline. It calculates based on the estimated time to complete the WU. Which is not going to change just because deadline is changed. | |
|
Scott Brown Volunteer moderator Project administrator Volunteer tester Project scientist
 Send message
Joined: 17 Oct 05 Posts: 2165 ID: 1178 Credit: 8,777,295,508 RAC: 0
                                     
|
IF you have a dedicated crunching machine that works 24/7, you really should take Michael's advice and set your BOINC work cache from .2 days to 0. (Scott Brown - are you reading this?)
Yes, I am reading this as I do almost all forum posts (though I don't always have time to reply). If you are suggesting that I set my cache to 0 rather than .2 days, that has actually been the case for a very long time for me (i.e., years). Indeed, I have never used .2 as a setting (I used to use .1 cache back before the zero setting worked as it does now--this was a VERY long time ago--and recently discovered that I had not changed this setting on a project to which a couple of my machines are still attached where I no longer actively crunch and recently changed this). Maybe I missed one of those machines/projects? Did you notice one of my machines incorrectly caching a large amount of work?
| |
|
Michael Goetz Volunteer moderator Project administrator
 Send message
Joined: 21 Jan 10 Posts: 13513 ID: 53948 Credit: 237,712,514 RAC: 0
                           
|
Side question;
Will there be android Work Units again?[/b]
I would like to say yes, but unfortunately the app is broken, the original developer is no longer available, and nobody else has volunteered to fix or rewrite it. The android app never actually worked -- and I take the blame for accepting the developer's word for the app working. (I won't make that mistake again. That's the reason you see us doing extended testing of most new apps.)
____________
My lucky number is 75898524288+1 | |
|
Michael Goetz Volunteer moderator Project administrator
 Send message
Joined: 21 Jan 10 Posts: 13513 ID: 53948 Credit: 237,712,514 RAC: 0
                           
|
One final question:
If you were making the decisions, how long would you make the deadlines, and why?
4 days minimum for the short tasks, it allows for three-day weekends.
Noted.
Prime-finding is not a time critical endeavor, demanding quick turn around just seems foolish.
Indeed, prime hunting is definitely not for the "instant gratification" mindset! Nevertheless, the reason for shorter deadlines isn't as much for quicker results as it is for faster validation (or challenge cleanups). There are people who *do* keep their machines crunching 24/7, and keeping them happy is important too. One could argue that keeping them happy is more important since they do more crunching, but my goal is to keep everyone happy.
Many crunchers run multiple projects, short deadlines over-taxes the feeble mindedness of the Boinc scheduler. Not all projects work well with a 0.0 queue, that is their servers are not nearly as robust as the PG servers so fewer server requests is better.
Based on personal experience, my answer to that is "Don't run multiple BOINC projects simultaneously. Even if you can't avoid it, find a way to avoid it."
The BOINC scheduler almost never does what you want it to do when you're running more than one project. I eventually just threw in the towel and now only run one project at a time on any given computer. It's much easier that way.
If you're running multiple projects simultaneously, you're just asking for trouble.
I can't predict what other projects people may run, what that characteristics of their jobs will be like, or how the BOINC client is going to behave given any potential mix of projects. One thing to remember is that when BOINC is missing deadlines, or going into high priority mode, it really doesn't matter how long or short the deadlines are. The BOINC client has a habit of delaying task starts until it's too late. If the deadlines are longer, it may just start the task later. The problem doesn't go away.
The most practical solution is to run only one project at a time, and keep your cache size well below the deadline. At PrimeGrid, there's built-in incentive (increasing likelihood of being credited with discovering a prime) to run with minimal or zero queues.
I know some other projects are much less reliable than we are. We've put a LOT of effort into increasing reliability -- and nonetheless we still go down occasionally. SETI is a good example. If I were running SETI right now, I'd keep a pretty large cache of work on my computer. I'd also set up a backup project. The problem, of course, is that combining SETI's unreliability (requiring large queues) with projects with short deadlines doesn't work very well.
Is it fair to ask us to modify our project because SETI isn't reliable or SIMAP only has work periodically? (Yes, I know SIMAP shut down -- but it's a good example.)
Thanks for your input. It does give us something to think about.
____________
My lucky number is 75898524288+1 | |
|
|
IF you have a dedicated crunching machine that works 24/7, you really should take Michael's advice and set your BOINC work cache from .2 days to 0.
I think this is bad thing. Work cache setted to 0 works well if there are no problems. If there are some problems with connection to server, BOINC sets a delay between next connection. If next connection is failed too, the delay increments. And BOINC has poor algorithm to do an increment delay, so it happens the computer have no work during some time, though connection is alredy available.
If cache setted to 0.5 or 1 day, there are considerably less problems, imho. So I set non-zero cache on almost all my computers. In my opinion, 0.5 day cache is a good choice.
And yes, I am not driving for primes :-). Only scores :-)
We're going to reduce the deadline for TRP-Sieve tasks to three days. Currently it's 4 days, despite these being very short tasks.
I have an Atom 270 notebook, it runs 2-3 hours every evening. So I can't crunch anything on it because a shortest WU is TRP-sieve, but the deadline is not enough to crunch on this PC even TRP-sieve WUs.
So I think reducing the deadline is not a good idea if there aren't strong arguments. | |
|
|
If you were making the decisions, how long would you make the deadlines, and why?
Because sieving is not joined with primefinding, and because TRP-Sieve has the shortest WUs at Primegrid, I think the slow PCs can contribute to primegrid by crunching the TRP-Sieve. But the deadline limits. So I think it will be good to extend the deadline to 5-6 days for this project.
Or you can make a separate sieve project for slow computers. Like in PPS there are PPS extended with short WUs, PPS with more long WUs, and PPS Mega with long WUs. | |
|
Michael Goetz Volunteer moderator Project administrator
 Send message
Joined: 21 Jan 10 Posts: 13513 ID: 53948 Credit: 237,712,514 RAC: 0
                           
|
I have an Atom 270 notebook, it runs 2-3 hours every evening. So I can't crunch anything on it because a shortest WU is TRP-sieve, but the deadline is not enough to crunch on this PC even TRP-sieve WUs.
So I think reducing the deadline is not a good idea if there aren't strong arguments.
This is the notebook which last connected to PrimeGrid in April of 2014? I was going to ask how long the tasks took on your notebook, but since it hasn't crunched any of our tasks in almost a year there's no tasks to look at.
Looking at other Atom computers in the database, there's no 270s currently running those tasks, but there are N450s. That's a faster CPU than the 270, but it's the closest I have.
The 450 takes about 7 hours for a TRP sieve task -- but only about 5 hours of CPU time (I guess it's using a lot of CPU to surf the web, or whatever). But your CPU is slower.
There has to be a limit somewhere as to how "slow" a computer we want to accomodate. Taking it to a ridiculous extreme, "I want to run SoB on my P90, which I only run for 30 minutes a week" makes no sense, not only because it would take forever, but also because computers like that, as well as computers that are used like that, can not possibly contribute a significant amount of work to any project. In advertising terms, it's not the demographic we're really looking for.
However, your point is noted.
____________
My lucky number is 75898524288+1 | |
|
Michael Goetz Volunteer moderator Project administrator
 Send message
Joined: 21 Jan 10 Posts: 13513 ID: 53948 Credit: 237,712,514 RAC: 0
                           
|
I've changed the thread title from "Reducing TRP-Sieve deadline to 3 days" to "Reducing TRP-Sieve deadline to 3 days, or increase everything to 4 days?"
I want to expand this discussion to include the possibility of increasing all 3 day projects to 4 days -- the exact opposite of reducing TRP-Sieve from 4 to 3 days.
____________
My lucky number is 75898524288+1 | |
|
Michael Goetz Volunteer moderator Project administrator
 Send message
Joined: 21 Jan 10 Posts: 13513 ID: 53948 Credit: 237,712,514 RAC: 0
                           
|
If you were making the decisions, how long would you make the deadlines, and why?
Because sieving is not joined with primefinding, and because TRP-Sieve has the shortest WUs at Primegrid, I think the slow PCs can contribute to primegrid by crunching the TRP-Sieve. But the deadline limits. So I think it will be good to extend the deadline to 5-6 days for this project.
Or you can make a separate sieve project for slow computers. Like in PPS there are PPS extended with short WUs, PPS with more long WUs, and PPS Mega with long WUs.
I can do that. However, I'm going to play devil's advocate and ask, "Why should we?"
These computers are VERY slow and can only contribute a tiny amount of computing power to our project (or any project). Furthermore, unlike the argument for creating Android apps, there's also very few computers like this, so their aggregate computing power is also miniscule.
Looking at the big picture (from the project side), going out of our way by creating projects specifically for super-slow computers doesn't seem to make a lot of sense.
(It should be noted that there are inherent BOINC limitations in the number of sub-projects we can run. They're a limited resource, so we wouldn't want to use one just to support a small number of computationally challenged cpu's.)
____________
My lucky number is 75898524288+1 | |
|
|
I have an Atom 270 notebook, it runs 2-3 hours every evening. So I can't crunch anything on it because a shortest WU is TRP-sieve, but the deadline is not enough to crunch on this PC even TRP-sieve WUs.
So I think reducing the deadline is not a good idea if there aren't strong arguments.
This is the notebook which last connected to PrimeGrid in April of 2014? I was going to ask how long the tasks took on your notebook
Yes, this notebook. As far as I remember, it crunch TRP-Sieve WU in about 7 hours. Hiperthreading doesn't matter. So a smartfone with Android is usually faster :-).
But if you want I can measure speed again.
These computers are VERY slow and can only contribute a tiny amount of computing power to our project (or any project). Furthermore, unlike the argument for creating Android apps, there's also very few computers like this, so their aggregate computing power is also miniscule.
The Android app is argument in a future, I think.
For me participating is more important than contributing. I have several computers that crunch Primegrid, some of them are fast enough.
It should be noted that there are inherent BOINC limitations in the number of sub-projects we can run.
How are strong the limitations? | |
|
Neo Volunteer tester
 Send message
Joined: 28 Oct 10 Posts: 710 ID: 71509 Credit: 91,178,992 RAC: 0
                   
|
Yes, I am reading this as I do almost all forum posts (though I don't always have time to reply). If you are suggesting that I set my cache to 0 rather than .2 days, that has actually been the case for a very long time for me (i.e., years). Indeed, I have never used .2 as a setting (I used to use .1 cache back before the zero setting worked as it does now--this was a VERY long time ago--and recently discovered that I had not changed this setting on a project to which a couple of my machines are still attached where I no longer actively crunch and recently changed this). Maybe I missed one of those machines/projects? Did you notice one of my machines incorrectly caching a large amount of work?
Yeah, in fact I did.... However, I just looked at a three of your systems and they seem to be set as you say... and the "In Progress" totals seem correct... Which is odd, because during the TDP, I was checking out your computers and thought that you would easily win the TDP if your w/u cache wasn't set so high... Oh well.... Enough micromanaging other's computers for me.... :)
Neo | |
|
Scott Brown Volunteer moderator Project administrator Volunteer tester Project scientist
 Send message
Joined: 17 Oct 05 Posts: 2165 ID: 1178 Credit: 8,777,295,508 RAC: 0
                                     
|
we?"
Looking at the big picture (from the project side), going out of our way by creating projects specifically for super-slow computers doesn't seem to make a lot of sense.
At the Collatz project, there are different size units of the same type that are selectable as different applications (I think). Would this be possible to do with sieves (i.e., a micro, mini, regular, and mega version of a TRP sieve to be run on machines of varying speed)?
____________
141941*2^4299438-1 is prime!
| |
|
Scott Brown Volunteer moderator Project administrator Volunteer tester Project scientist
 Send message
Joined: 17 Oct 05 Posts: 2165 ID: 1178 Credit: 8,777,295,508 RAC: 0
                                     
|
Yes, I am reading this as I do almost all forum posts (though I don't always have time to reply). If you are suggesting that I set my cache to 0 rather than .2 days, that has actually been the case for a very long time for me (i.e., years). Indeed, I have never used .2 as a setting (I used to use .1 cache back before the zero setting worked as it does now--this was a VERY long time ago--and recently discovered that I had not changed this setting on a project to which a couple of my machines are still attached where I no longer actively crunch and recently changed this). Maybe I missed one of those machines/projects? Did you notice one of my machines incorrectly caching a large amount of work?
Yeah, in fact I did.... However, I just looked at a three of your systems and they seem to be set as you say... and the "In Progress" totals seem correct... Which is odd, because during the TDP, I was checking out your computers and thought that you would easily win the TDP if your w/u cache wasn't set so high... Oh well.... Enough micromanaging other's computers for me.... :)
Neo
Actually, I just found one project that I had completely forgotten about that a couple of machines were still attached to where the cache was still set to .1 (they were still attached to maintain the cross-project id to keep the stats reported correctly in BOINC stat site totals). So thanks for the "heads up"...I think I have them all corrected now.
| |
|
|
The reason for shorter deadlines isn't as much for quicker results as it is for faster validation (or challenge cleanups) The tasks causing the frustration are likely the long tasks not the short tasks. Cleanup for short tasks happens quick enough that many do not notice it.
If you're running multiple projects simultaneously, you're just asking for trouble. I would (mostly) disagree. In my case, running 8 threads of LLR generates cooling problems (I live in the California Central Valley), running 3 thread LLR and 5 threads on other projects solves both the cooling problems and LLR/hyperthreading problems.
Is it fair to ask us to modify our project because SETI isn't reliable or SIMAP only has work periodically? (Yes, I know SIMAP shut down -- but it's a good example.) You should not run your project based on shortcomings of other projects, but projects should be mindful that crunchers may participate in multiple projects not just one project. Otherwise we may just as well go back to the days before Boinc.
I've changed the thread title from "Reducing TRP-Sieve deadline to 3 days" to "Reducing TRP-Sieve deadline to 3 days, or increase everything to 4 days?"
I want to expand this discussion to include the possibility of increasing all 3 day projects to 4 days -- the exact opposite of reducing TRP-Sieve from 4 to 3 days.
You are now making my head spin.
____________
Werinbert is not prime... or PRPnet keeps telling me so.
Badge score: 1x1 + 12x3 + 1x4 + 1x5 + 1x6 + 2x7 + 1x8 + 1x10 = 84 | |
|
|
I was used to work with the same figures (0.5 day + 0.5 day), and I usually have around 1 day of work in queue for each project or subproject. When a queue decreases to its lower limit, I'm receiving a bunch of new WUs. But Primegrid behaviour is very strange : GPU tasks duration is underestimated whilst CPU tasks duration is overestimated, so the planned execution time for both is playing yoyo in a 1 to 4 range. When high, I have only a few WUs in queue. When low, I'm receiving a lot of WUs, so they turn to high priority, monopolize the resources and fall out of time. A real mess! The only solution I've found is to reduce the buffer size: I'm now at 0.2d + 0.2d and it runs. Using lower values is risky as I don't have a permanent Internet link to all Project servers.
You should understand that, as soon as computers have several WUs in queue, there is no relation between deadlines and task duration. If PRIMEGRID reduces its deadlines, participants will have to reduce their pending workload, that will effect ALL other projects.
I will try to go to 0d+0d. If not satisfactory, I will stop crunching for Primegrid.
Please note that I'm only running short tasks, as a single PrimeGrid long task require more than 50% of resources availability of 1 thread to complete in time.
As example, an openCLPPSsleeve WU takes 4 hours to complete on my IMAC, and I have 1 WU running and 8 WUs in queue. Total working time: 36h. For heating protection, my GPU doesn't work when I'm using the computer. So I should clear this queue in around 3 days if running only this subproject. But I'm using BOINC, based on multi project distributed computing. If running only 2 projects and 2 Primegrid subprojects in Parallel with GPU WUs, only 25% of GPU resources are available for this single subproject, so it will not take 3 days but 12 to clear the queue and get new WUs. Look at the deadline! This has no sense in a multi project environment, except if Primegrid plans to monopolize 100% of participants resources for its own project.
The Primegrid deadlines already are ridiculously short. Don't try to reduce them any more. The most important Challenge for this project is to make participants' life easy. | |
|
|
I was used to work with the same figures (0.5 day + 0.5 day), and I usually have around 1 day of work in queue for each project or subproject. When a queue decreases to its lower limit, I'm receiving a bunch of new WUs. <snip>
This seems stated incorrectly. If you have your settings for 0.5 + 0.5 you should keep a supply of work between 0.5 and 1 days for each computing core/unit you have available, this limit is not for each project you are connected to but for the whole computer.
For example if I have a computer with 2 CPU cores + 1 GPU core I should have 1-2 (2 of 0.5-1) computing days worth of CPU work and 0.5-1 days of GPU computing work no matter how many projects I am connected to.
____________
| |
|
|
4 days deadline will be a gift for weak computers and users who didn't use their computers very often | |
|
|
You're right: in order to get 0.5+0.5, I've set buffer sizes to 0,5d/1d.
Yesterday, I tried to go down to 0/0. The queues have been reduced to the minimum, but, as some project servers (and my Internet connection) are not 100% available, I spent long times without work. So I absolutely need a reserve of work.
I went back to 0.1d/0.2d. With 3 CPU threats active, I should have between 7,5h and 15h of total CPU load and between 2,5h and 5h of GPU load. Please note that I'm running 2 projects at 100-100 and that the GPU don't work when the PC is used.
FALSE: after an automatic update, the total CPU workload is now 164h for Primegrid (7 WUs for 4 subprojects) + 3 hours for another project (6 WUs), and the GPU workload is 25h for a single Primegrid subproject (6 WUs in queue + 1 in progress).
Running 24/7 in absence of other use, the maximum available time per project and per day for my PC is 24h x 3 threats x 0.5 = 36h, and 164h correspond to 4.5 days.
With 4-day deadlines, it's already hard to complete in time. With 3-day deadlines, I'm completely out. | |
|
|
My point of view:
24/7 machines: if a buffer set according to the CPU power, no problem for both DLs.
9/5 business/office desktop machines: 4 days DL means serious problem (buffer must be set under 0.9), 3 days DL means unusable application (or buffer < 0.1) | |
|
|
A wise solution should be to multiply all deadlines by a factor of 2 or 3. | |
|
|
Well, I'll admit, I am now a bit confused. I run a mix of projects, primegrid is assigned 50% of 4 cores running at 50%. The next three projects (ATLAS, Einstein, VirtualLHC) take up a combined 25%. Einstein usually sends me GPU tasks. My 3 low priority projects take up the remaining 25%. I run 0/0.
I run PoP and PSP both of which are relatively long WUs.
My point of this is that I don't see the kind of scheduling difficulties that apparently happen to other users. I don't expect the BOINC scheduler to honor the priorities strictly, but in general, it does pay attention to the overall assignments. So why am I not having the same issues as other, not that I am complaining :-)?
____________
Thanks,
Jim
| |
|
|
So therefore, I have no problem with either setting of TRP. | |
|
|
4 days. I don't have a convincing, deductive argument either way for 3 vs. 4, but 4 seems like a nice compromise for the "short work".
- It's more inclusive for slower or "part time" boxes
- It better handles the "long weekend" problem
- Won't appreciably aggravate the "waiting for a wingman" problem
- Still pretty short compared to other BOINC projects
- I do not favor a big increase, like making the deadline a week or more
On the other topic, I usually run with a 0.01 day cache. Seems to work well for me (my network can be busy/flaky at times, so I don't like a "0" cache). Your mileage may vary.
--Gary | |
|
|
Grrr...I messed up.
I described my LLR machine, not my sieve machine.
I run two sieves, TRP and ESP. They both take about 40 minutes to run on an old MacPro. Prime grid is allocated 50% of a 4-core system which is operating at 50%. Einstein, VirtualLHC, Milkyway and Seti share the remaining 50%.
I have never had a problem with getting enough sieves to run. I am running at 0/0. I do not anticipate much change if TRP Sieve goes to three days.
Jim | |
|
|
Personally I have stopped bothering with Prime Grid tasks simply because they don't allow enough time. If I go on holiday there are too many tasks that run out of time or have to be run as high priority when I get back.
These days I only work for projects that allow 14 days.
Cutting your already stupid 4 days to 3 is just going to alienate more people. And what for? The numbers have been prime or not since before the start of the universe and still will be in another few days. What's the rush? | |
|
|
When I am away from my machines, I just turn them off. That is as much for security's sake as anything, but it does try around the problem that Nick has.
____________
Thanks,
Jim
| |
|
|
These tasks take less than 40 minutes on average to finish. 3 days (10800 minutes) divided by 40 says approximately 270 (or more) on average can be done for a machine that is 24x7. If you machine runs 8 hours a day instead of 24 you can still do 90 or more in 3 days. I am unsure where the logic of having to have 4 days is. These are sieve tasks, they help keep the LLR tasks cleaner by removing known composite numbers. In it's current iteration it will never find a prime from this.
I say put it at 3 days. I understand about outages and stuff, but since tasks need two people to validate so you most likely will be the second man in, so what. Even if delayed by a day and someone else gets the same task it still is in the database for a few days before deleted and you will still get your credit.
Keeping the LLR releases cleaner is a mighty important job for the sieves. Yes 4 days work, but if timed out slow down the process, then 8 days then 12 days. Now at 12 days and 3 day deadline you have to get an extra chance at a wingperson if it times out that many times giving you a better chance at the work being completed.
I am unsure why this became a discussion anyway, ESP sieve is a little longer in completion time and goes 3 days and I have never seen anyone complain about it. This just became an issue because PG announced they were making the change instead of just doing it. I bet not many people would have even noticed the change. | |
|
|
4 days. I don't have a convincing, deductive argument either way for 3 vs. 4, but 4 seems like a nice compromise for the "short work".
- It's more inclusive for slower or "part time" boxes
- It better handles the "long weekend" problem
- Won't appreciably aggravate the "waiting for a wingman" problem
- Still pretty short compared to other BOINC projects
- I do not favor a big increase, like making the deadline a week or more
I agree with the 4 day increase. It doesn't personally affect me, as I only run PrimeGrid and even my slowest computer can do an ESP sieve in an hour and a half, but if it helps people with slower computers/multiple projects/unreliable internet, I don't see any downside to increasing the deadline for the short projects. Like Nick Warren said, nothing is going to happen if the task takes 1, 3, or even 10 days longer to validate. Correct me if I'm wrong, but I don't see any ridiculous validation problems on all but the longest sub-projects. Therefore, it seems like increasing the deadline would benefit quite a few people, but negatively impact nobody. | |
|
|
I agree.
Jim | |
|
Dave  Send message
Joined: 13 Feb 12 Posts: 2829 ID: 130544 Credit: 954,793,678 RAC: 0
                     
|
3 days to get the LLR cleaner sooner.
Poll! | |
|
|
If this is simply to help clean up after challenges, then I don't see why it is a problem in the first place. If it were something like SOB, then maybe. I have a 2P AMD rig that takes a couple months to complete those work units. So, I can see the hurry to finalize the stats reporting. (though still not fair for those whom don't care about the challenge) But for a very short work unit? That is just silly to be concerned about...
I don't see any other reason to demand a short deadline. I do see more problems arising by shortening it than good. If the tasks go into panic mode due to becoming "high priority" then BOINC will pause GPU work to squeeze every ounce of CPU time out to complete work. This happens even if you reserved a full core for GPU work. Reducing the deadline will only increase this potential headache. If anything, deadlines for the shorter work units should be increased as there is no needed rush for them.
I typically keep a 0 or near 0 cached. I also tend to run multiple projects. Very rarely do I run into the above issue, but it does still occur from time to time. I would think encouraging the potential scenario above with shorter deadlines would be counter productive as that would suspend greater work being done on the GPU's even if someone was only attached to PG. Just my $.02.
____________
| |
|
|
Personally I have stopped bothering with Prime Grid tasks simply because they don't allow enough time. If I go on holiday there are too many tasks that run out of time or have to be run as high priority when I get back.
These days I only work for projects that allow 14 days.
Cutting your already stupid 4 days to 3 is just going to alienate more people. And what for? The numbers have been prime or not since before the start of the universe and still will be in another few days. What's the rush?
I couldn't agree more. I now run Primegrid only occasionally to see if the deadlines are more realistic against the amount of processing time required, but nothing has changed for the better; rather it seems that it is about to change for the worse. The suggestion that we should run Primegrid exclusively smacks of arrogance; the whole point of BOINC is to run multiple projects, and those other projects generally seem to manage very well.
My laptop pc (with a quad-core I3) runs mostly between 08h30 and 19h30 daily, and has no problem processing other projects' work comfortably within their deadlines; little chance of that with Primegrid.
| |
|
|
Regarding TRP-Sieve, increasing or decreasing by one day won't make any difference to me.
For longer tasks like SoB or GFN-WR, please don't ever increase the deadline period unless a change in the tasks warrants doing so. I see too many people who decide for whatever reason to load up on a cache of tasks - I'm talking dozens of 'em. Not only do they not complete most of the tasks before the deadline, they haven't even begun work on the vast majority of them. I realize that the thread topic is about TRP-Sieve, but I'm getting the impression that some people would like all deadlines increased over what they are now.
I run zero or close to a zero buffer of downloaded tasks. My machine normally runs 24/7/365 with a typical cable internet connection.
I agree that PrimeGrid should try to accommodate a good cross section of people with different types of hardware, intermittent internet connections, and perhaps limited computer 'on' time. Just don't try to accommodate everyone with the worst case scenario of task crunching.
It's like eating at a restaurant buffet (for us gluttons) - don't take what you can't finish. If you run out of food, come back for more after you've finished eating what you have. | |
|
|
I have the same feeling. I'm in trouble using Primegrid on all my computers as the deadlines are too short. But there may be another problem behind.
I'm running openclPPSsieveMAC on an iMac / AMD GPU / BOINC 7.4.36, and no other project or subproject uses the GPU. My working conditions require a reasonable buffer size (6 to 12 h of work).
Then the deadline is a problem because it receives a lot of openclPPSsieveMAC WUs at each Primegrid download, representing 10 to 12 times the maximum buffer size. There is no problem for cleaning: it's immediate when a WU complete.
Is there anybody able to explain why ? | |
|
|
In my computers, the cleaning is immediate but the execution isn't (due to waiting list and time sharing). I don't bother about deadlines, except when they become critical to empty the waiting list in time. It's already the case for a lot of "short" Primegrid subprojects. A week-end may last up to 110 hours, and running more than 8h/threat or 8h/GPU in each available working day is totally irrealistic in a timesharing environment. | |
|
Michael Goetz Volunteer moderator Project administrator
 Send message
Joined: 21 Jan 10 Posts: 13513 ID: 53948 Credit: 237,712,514 RAC: 0
                           
|
Thank you all for your input! It was very educational, and I assure you we paid attention to everyone who voiced an opinion, both on the forums and privately.
I'm closing down this thread as it's served its purpose. Based on your input we will be making some deadline changes, All 3 day deadlines are going to be increased to 4 days, in order to accommodate long weekends.
The following is an explanation. It's not an argument nor a discussion point:
I understand the "I care about BOINC, not primes" viewpoint that long deadlines are better, but this IS PrimeGrid. "Prime" is in the name, and that's what we're all about. Finding primes is a big deal for most people here, and the shorter the deadline, the sooner the primes get reported and the quicker the individual is informed that they discovered a new prime number!
That's why we like to keep the deadlines short.
(It also helps with challenge cleanups, and that's important to a lot of people.)
____________
My lucky number is 75898524288+1 | |
|
Message boards :
The Riesel Problem :
Reducing TRP-Sieve deadline to 3 days, or increase everything to 4 days? |