No tasks
log in

Advanced search

Message boards : Number crunching : No tasks

Author Message
Orange Kid
Send message
Joined: 19 Oct 17
Posts: 2
Credit: 3,463,032
RAC: 0
Message 1350 - Posted: 12 Sep 2018, 17:09:54 UTC

The server is out of work and a Formula Boinc sprint is in progress.

Skillz
Send message
Joined: 23 May 17
Posts: 1
Credit: 7,496,041
RAC: 0
United States
Message 1351 - Posted: 12 Sep 2018, 20:35:09 UTC

We need tasks!

xii5ku
Send message
Joined: 20 Jul 17
Posts: 14
Credit: 35,953,451
RAC: 0
Message 1352 - Posted: 12 Sep 2018, 20:52:24 UTC
Last modified: 12 Sep 2018, 21:41:33 UTC

Orange Kid wrote:
The server is out of work and a Formula Boinc sprint is in progress.

Link to Formula Boinc sprint page:
http://formula-boinc.org/sprint.py?sprint=15&year=2018

H|Skillz wrote:
We need tasks!

As far as I can tell, recent Formula Boinc sprints cause about more than double (quite possibly triple) the production compared to normal days at projects which (a) are whitelisted by Gridcoin = already have a relatively high daily baseline of participation and (b) are not constrained by work generator pace or validator problems or bandwidth or whatnot.

TN-Grid is whitelisted by Gridcoin, but it has a notoriously low rate of work generation. Long story short: "We need tasks!" -> Good luck with that. :-(

Edit, quoting from post 1133:
On 19 October 2017 valterc wrote:
The way we produce work is rather complicated (computationally speaking), at the moment this is the maximum pace we can achieve.

Profile valterc
Project administrator
Project tester
Send message
Joined: 30 Oct 13
Posts: 623
Credit: 34,677,535
RAC: 1
Italy
Message 1353 - Posted: 13 Sep 2018, 9:47:02 UTC - in response to Message 1352.

I didn't know about Formula BOINC Sprint but I noticed a huge increase of workunit requests.
For your reference the current pace of the work generator is actually around 488 new workunits every 15-18 minutes.

Orange Kid
Send message
Joined: 19 Oct 17
Posts: 2
Credit: 3,463,032
RAC: 0
Message 1354 - Posted: 13 Sep 2018, 13:30:33 UTC - in response to Message 1353.

I didn't know about Formula BOINC Sprint but I noticed a huge increase of workunit requests.
For your reference the current pace of the work generator is actually around 488 new workunits every 15-18 minutes.


Anything you can do to increase the output for the next three days will help the project move forward by leaps and bounds. :)

Profile marsinph
Send message
Joined: 18 Apr 18
Posts: 4
Credit: 3,292,957
RAC: 0
Belgium
Message 1355 - Posted: 13 Sep 2018, 15:45:44 UTC
Last modified: 13 Sep 2018, 15:53:34 UTC

Hello, about available work, it is very easy to understand !
Since the project on "Sprint" is known, some very big team with hundreds of hosts, downloaded the most WU.
But not returned it. I will not write the name of such teams. There are knowns.
But those team, runs the WU without returning them. They wait the official start
to upload all WU crunched the past day. It is they strategy !!!
They take all WU, wait, and when there are again available WU, it is not enough for normal user to increase.

Then about the amount of WU / host, increase cache will nothing change.
The project limits 8 simultanous WU / core.
So with a 8cores, you only can receive 64 WU. I agree with this politics.
So WU stay not too long out in field.

The problem is with a "Sprint" Some team with hundreds of hosts, take all WU, then returns it during soprint, then after do NOTHING for the project.
Then they crunch only for personnal ranking, wait the next 3sprint" and do the same again...

Look only the stats on Formula BOINC, in all divisions !!!
Look very carefully the ranking stats on "Sprint"

It explain why a lot of people have difficults to get WU.
The server produce WU normally, like each normal day and it is enough.
So, the server is not in overload. It is very wise from Admin. And I says again, i fully agree.

T6he look the stats from the latest 24Hr !! 20 new users but strange 174 hosts !!!
Easy to count : Let us start that there are also honnest users .
But then after less than one day, each new user is connected with about 15 hosts !!!!!!!!!!!!!!!!!!!!!!!
Very strange !

Best regards

xii5ku
Send message
Joined: 20 Jul 17
Posts: 14
Credit: 35,953,451
RAC: 0
Message 1356 - Posted: 13 Sep 2018, 17:58:21 UTC - in response to Message 1353.
Last modified: 13 Sep 2018, 18:16:07 UTC

valterc wrote:
For your reference the current pace of the work generator is actually around 488 new workunits every 15-18 minutes.

~145 credits/task * 2 tasks/WU * 488 WUs / ~18 minutes * 1440 minutes/day = ~11 M credits/day

This is looking good! The project is seeing ~3 M credits/day normally.

Mark Sango
Send message
Joined: 27 Sep 17
Posts: 2
Credit: 155,413
RAC: 0
Message 1357 - Posted: 13 Sep 2018, 20:07:27 UTC - in response to Message 1355.

Hello marsinph !

I'm a member of team Alliance Francophone consisting of volunteers from many countries who are using the french language. I live in Strasbourg, France.

I think that your argument that "some teams with hundreds of hosts, take all WU (you mean "take before the sprint starts",I think), then return them during the sprint." is not quite true, because Formula Boinc generally announces the selected project only when the exact day and time (in UTC, that is the former United Kingdom based Greenwich mean time) is reached.

The current TN-Grid Plaform sprint is an exception to the rule. While consulting the Formula Boinc page on 12 Sept 2018 at 22:00 UTC I saw that the project had been announced at least 18 hours before 13 Sept 2018 16:00 UTC ! I don't know why this happened.

Even knowing the project in advance, I did not try to download work units beforehand as I considered it unethical. I even didn't try to see the number of tasks currently ready to send because I always thought that work units downloaded before the official would be disqualified.

Having been delayedby by an urgent task at my work, I only started requesting tasks from my home at 17:04 UTC and got zero tasks. Minutes later, I saw zero tasks ready to send on the project's, then saw your message. Just before sending my answer, I found that my Boinc Manager had got 4 tasks at 17:17 UTC having been crunched almost 75% at 21:50 UTC.

That's more then I feared !

Keep up the good work !
____________

xii5ku
Send message
Joined: 20 Jul 17
Posts: 14
Credit: 35,953,451
RAC: 0
Message 1358 - Posted: 14 Sep 2018, 4:46:12 UTC - in response to Message 1357.
Last modified: 14 Sep 2018, 4:47:33 UTC

@Marko Sango,
the project which is chosen for a Formula BOINC sprint is announced exactly 24 hours before the start of each sprint. (Except when Sebastien forgets to update the site.)

A reminder at when exact date and time the next sprint project will be announced is appearing at the Formula BOINC site a week in advance of each sprint.

Profile marsinph
Send message
Joined: 18 Apr 18
Posts: 4
Credit: 3,292,957
RAC: 0
Belgium
Message 1359 - Posted: 14 Sep 2018, 6:02:33 UTC - in response to Message 1358.

@Marko Sango,
the project which is chosen for a Formula BOINC sprint is announced exactly 24 hours before the start of each sprint. (Except when Sebastien forgets to update the site.)

A reminder at when exact date and time the next sprint project will be announced is appearing at the Formula BOINC site a week in advance of each sprint.



Hello,
The date an time till enf the year is already known
http://formula-boinc.org/sprint.py?lang=&year=2018

xii5ku
Send message
Joined: 20 Jul 17
Posts: 14
Credit: 35,953,451
RAC: 0
Message 1360 - Posted: 14 Sep 2018, 7:20:37 UTC

Number of tasks in progress:
- was constantly at 30,000 for many days until Tuesday
- went to 35,000 on Wednesday for no apparent reason
- steadily climbed to almost 70,000 since the sprint announcement until now, and is still rising

xii5ku
Send message
Joined: 20 Jul 17
Posts: 14
Credit: 35,953,451
RAC: 0
Message 1362 - Posted: 15 Sep 2018, 19:18:04 UTC - in response to Message 1356.

xii5ku wrote:
valterc wrote:
For your reference the current pace of the work generator is actually around 488 new workunits every 15-18 minutes.

~145 credits/task * 2 tasks/WU * 488 WUs / ~18 minutes * 1440 minutes/day = ~11 M credits/day

This is looking good! The project is seeing ~3 M credits/day normally.

@valterc, at this point it looks like you meant 488 new tasks, not WUs, per 15-18 minutes.

~150 credits/task * 488 tasks / 15...18 minutes * 1440 minutes/day = ~6...7 M credits/day

This aligns with the total production of the project today and yesterday, as seen on free-dc or boincstats. Unfortunately this means, as a very rough guesstimation, that perhaps 1/2 of the computer capacity which volunteers would like to put to task during this sprint remains without work.

The number of tasks ready to send remain near zero. IOW even though less than a day remains in this sprint, there is still more demand for new work than there is supply.

[H]auntjemima
Send message
Joined: 11 Aug 18
Posts: 2
Credit: 131,503
RAC: 0
Canada
Message 1363 - Posted: 15 Sep 2018, 19:45:52 UTC - in response to Message 1362.

xii5ku wrote:
valterc wrote:
For your reference the current pace of the work generator is actually around 488 new workunits every 15-18 minutes.

~145 credits/task * 2 tasks/WU * 488 WUs / ~18 minutes * 1440 minutes/day = ~11 M credits/day

This is looking good! The project is seeing ~3 M credits/day normally.

@valterc, at this point it looks like you meant 488 new tasks, not WUs, per 15-18 minutes.

~150 credits/task * 488 tasks / 15...18 minutes * 1440 minutes/day = ~6...7 M credits/day

This aligns with the total production of the project today and yesterday, as seen on free-dc or boincstats. Unfortunately this means, as a very rough guesstimation, that perhaps 1/2 of the computer capacity which volunteers would like to put to task during this sprint remains without work.

The number of tasks ready to send remain near zero. IOW even though less than a day remains in this sprint, there is still more demand for new work than there is supply.


I disagree. Based on the time it takes to complete tasks, all this is really preventing is a bunkering of tasks at this point. There is more than enough work, even on my 26 cores, to keep busy the entire time.

xii5ku
Send message
Joined: 20 Jul 17
Posts: 14
Credit: 35,953,451
RAC: 0
Message 1364 - Posted: 16 Sep 2018, 7:57:42 UTC - in response to Message 1363.
Last modified: 16 Sep 2018, 8:50:32 UTC

[H]auntjemima,
until Saturday 18:00 UTC, server status always showed "tasks ready to send" to be zero, or almost zero. During this time, those who updated their clients more frequently than it would update by itself, got enough tasks to keep their hosts busy. Those who let their clients run freely, received almost no tasks.

(Over the course of 12 hours from Saturday 18:00 UTC on, "tasks ready to send" slowly climbed up and are at practically normal level now. This is of course because the sprint ends at Sunday 16:00 UTC, and TN-Grid's quota of 8 tasks in progress per logical CPU gives about a day worth of tasks -- less on quicker hosts, more on slower hosts. Meaning, those who participate in this sprint but will switch elsewhere after the sprint stopped requesting new tasks about a day before the sprint ends.)

My guess that the clients which remained idle make up roughly half of the entire computing capacity that was intended to run TN-Grid this weekend (for the sprint or otherwise) comes from the observation of how many points the various teams have by now, how points were distributed in sprints in which there was no scarcity of work, and from reading at a few forums.

--------
Edit:
It is a fact that "tasks ready to send" were at or very near zero constantly from Wednesday 16:00 UTC until some time after Saturday 18:00 UTC. (In addition, "tasks in progress" climbed from 35,000 to 65,000 between announcement and start of the sprint, and further to a peak of 79,000 during the sprint. It is now coming down slowly.) So, it is also a fact that demand for new work was higher than supply of new work, constantly from the announcement of the sprint until less than a day before the end of the sprint. IOW, there were hosts without enough work, as a matter of fact.

The only point to disagree on is how many hosts had not enough work; this one point was really just guesswork on my part. But it were certainly many.

--------
Edit 2:
I disagree on the other hand that bunkering was impossible. The slowness of the work generator does not prevent bunkering. It only prevents some bunkering methods from being effective, while other bunkering methods still work. (Bunkering = receiving new work but not reporting completed work; you can control the latter, only the former depends on the server having work available.)

xii5ku
Send message
Joined: 20 Jul 17
Posts: 14
Credit: 35,953,451
RAC: 0
Message 1365 - Posted: 16 Sep 2018, 11:24:45 UTC

PS,
message 1362 is not a complaint, merely a correction of what I wrote in message 1356. I understood that WU generation for gene@home is not trivial and cannot be increased by the flip of a switch.

Mark Sango
Send message
Joined: 27 Sep 17
Posts: 2
Credit: 155,413
RAC: 0
Message 1366 - Posted: 16 Sep 2018, 15:03:35 UTC - in response to Message 1364.

Except during the start of the sprint, it looks like I always had 8 tasks running on my 8 cores. And the 8 current tasks will not be finishe before the deadline.

Before the sprint, I select "No new tasks" for most projects with an exception for WUProp@home and sometimes projects with low CPU demand.

If the sprint project has no GPU application, I'm running in parallel GPU projects with a very low demand or CPU power.

Most of the time, I let the BOINC Manager run freely the task selection of the about 45 really active projects I've selected with different ressources percentages.

Best regards to all crunchers !
____________

Profile valterc
Project administrator
Project tester
Send message
Joined: 30 Oct 13
Posts: 623
Credit: 34,677,535
RAC: 1
Italy
Message 1367 - Posted: 17 Sep 2018, 9:34:46 UTC
Last modified: 17 Sep 2018, 9:37:49 UTC

@xii5ku:

@valterc, at this point it looks like you meant 488 new tasks, not WUs, per 15-18 minutes.

Yes, using the BOINC terminology, the work generator makes 294 "workunits" every 15-18 minutes, because of the validation strategy this implies 294*2 "tasks", ready to be distributed at the beginning. This could be a little bit confusing, I mean that many BOINC users talk about "workunits", but, actually, they are talking about "tasks".


Post to thread

Message boards : Number crunching : No tasks


Main page · Your account · Message boards


Copyright © 2024 CNR-TN & UniTN