OUT of tasks
log in

Advanced search

Message boards : Number crunching : OUT of tasks

Previous · 1 · 2
Author Message
Speedy
Send message
Joined: 13 Nov 21
Posts: 17
Credit: 421,300
RAC: 3,814
New Zealand
Message 2847 - Posted: 27 Aug 2022, 21:46:49 UTC - in response to Message 2844.

Thanks for the information. I couldn't agree with you more Tim about helping their project out in the short term. In saying this I am currently not running any tasks

Stiwi
Send message
Joined: 18 Sep 19
Posts: 9
Credit: 1,143,381
RAC: 368
Germany
Message 2848 - Posted: 27 Aug 2022, 23:24:40 UTC

Isn't it good if the project runs at maximum speed to get the results as fast as possible? So why do you complain?

Bryn Mawr
Send message
Joined: 23 Jun 20
Posts: 40
Credit: 11,269,665
RAC: 9,867
United Kingdom
Message 2850 - Posted: 28 Aug 2022, 10:50:51 UTC - in response to Message 2844.

Why would anyone set up a challenge involving a project that is known to be borderline supplying WUs on a day to day basis?

Not only does it make the challenge a lottery, it also messes up the long term volunteers.


With respect, the Project Admin was asked, IN ADVANCE, as to whether such a Challenge could be handled by the project.

However, the admin said that the project only issues about 600 tasks every 14 minutes...

Even so, this Challenge only lasts for 3 days (until Sunday at 9pm UTC) so it is hardly a long term inconvenience AND any members doing this Challenge are supporting a "smaller" project that can do with some short term help?

regards
Tim


Where a project has a fixed limit of 600 tasks every 14 minutes and the existing volunteers process 600 tasks every 14 minutes how are you providing short term help? This is my confusion.

If a project is in a position to provide a surge of tasks to coincide with the challenge then wonderful, work gets done faster, results get back to the researchers sooner, the challenge members have fun with a ready supply of tasks and everything is hunky dory but I cannot see the benefit of this to either party.

arcturus
Send message
Joined: 18 May 22
Posts: 12
Credit: 3,445,051
RAC: 16,446
United States
Message 2851 - Posted: 28 Aug 2022, 13:51:34 UTC - in response to Message 2850.

Where a project has a fixed limit of 600 tasks every 14 minutes and the existing volunteers process 600 tasks every 14 minutes how are you providing short term help? This is my confusion.


Because the existing volunteer pool isn't consuming the full 600 in 14 minutes is my guess as there's usually no shortage. This 'excess' is quickly eaten up with a challenge as we've seen.

If the number of volunteers grow, unless the project distributes more work, clearly there's a diminishing benefit to allowing challenges.

pututu
Send message
Joined: 26 Nov 16
Posts: 5
Credit: 8,309,494
RAC: 101,072
United States
Message 2853 - Posted: 28 Aug 2022, 17:45:24 UTC

Same issue as seen in the last formula boinc sprint in 2021 http://gene.disi.unitn.it/test/forum_thread.php?id=317#2363

Insufficient work generation.

Probably the same next year if there is a sprint.

UBT - Timbo
Send message
Joined: 2 May 15
Posts: 2
Credit: 1,158,080
RAC: 0
United Kingdom
Message 2854 - Posted: 28 Aug 2022, 19:58:44 UTC - in response to Message 2850.
Last modified: 28 Aug 2022, 19:59:14 UTC

Where a project has a fixed limit of 600 tasks every 14 minutes and the existing volunteers process 600 tasks every 14 minutes how are you providing short term help? This is my confusion.

If a project is in a position to provide a surge of tasks to coincide with the challenge then wonderful, work gets done faster, results get back to the researchers sooner, the challenge members have fun with a ready supply of tasks and everything is hunky dory but I cannot see the benefit of this to either party.


I note your comment BUT as of now (and as the Challenge comes to an end at 9pm UTC tonight) the project has

Tasks ready to send 933
Tasks in progress 57191


so, there seems to be a significant number of available tasks now and generally speaking also most days as well - and I guess that the regular volunteers have only been inconvenienced for maybe 2 or 3 days.

And in the meantime, if every days full quota of available tasks have all been crunched then the project gains from this, surely?

regards
Tim

Bryn Mawr
Send message
Joined: 23 Jun 20
Posts: 40
Credit: 11,269,665
RAC: 9,867
United Kingdom
Message 2855 - Posted: 29 Aug 2022, 11:27:35 UTC - in response to Message 2851.

Where a project has a fixed limit of 600 tasks every 14 minutes and the existing volunteers process 600 tasks every 14 minutes how are you providing short term help? This is my confusion.


Because the existing volunteer pool isn't consuming the full 600 in 14 minutes is my guess as there's usually no shortage. This 'excess' is quickly eaten up with a challenge as we've seen.

If the number of volunteers grow, unless the project distributes more work, clearly there's a diminishing benefit to allowing challenges.


If you guess was correct then the number of available work units would grow over time but it remains fairly stable in normal circumstances so I guess your guess is incorrect :-)

Bryn Mawr
Send message
Joined: 23 Jun 20
Posts: 40
Credit: 11,269,665
RAC: 9,867
United Kingdom
Message 2856 - Posted: 29 Aug 2022, 11:30:53 UTC - in response to Message 2854.

Where a project has a fixed limit of 600 tasks every 14 minutes and the existing volunteers process 600 tasks every 14 minutes how are you providing short term help? This is my confusion.

If a project is in a position to provide a surge of tasks to coincide with the challenge then wonderful, work gets done faster, results get back to the researchers sooner, the challenge members have fun with a ready supply of tasks and everything is hunky dory but I cannot see the benefit of this to either party.


I note your comment BUT as of now (and as the Challenge comes to an end at 9pm UTC tonight) the project has

Tasks ready to send 933
Tasks in progress 57191


so, there seems to be a significant number of available tasks now and generally speaking also most days as well - and I guess that the regular volunteers have only been inconvenienced for maybe 2 or 3 days.

And in the meantime, if every days full quota of available tasks have all been crunched then the project gains from this, surely?

regards
Tim


Ignore my grumbling, I’m just a grumpy old git not getting my usual daily fix and missing it.

arcturus
Send message
Joined: 18 May 22
Posts: 12
Credit: 3,445,051
RAC: 16,446
United States
Message 2857 - Posted: 29 Aug 2022, 12:49:31 UTC - in response to Message 2855.
Last modified: 29 Aug 2022, 12:50:29 UTC

If you guess was correct then the number of available work units would grow over time but it remains fairly stable in normal circumstances so I guess your guess is incorrect :-)


No I was correct. The demand imposed by added participants exceeded the project's production, plain and simple. With the contest over the demand has once again fallen below the work units produced. This bounce back in available work units is now stabilizing.

Stiwi
Send message
Joined: 18 Sep 19
Posts: 9
Credit: 1,143,381
RAC: 368
Germany
Message 2948 - Posted: 25 Oct 2022, 10:53:15 UTC
Last modified: 25 Oct 2022, 10:53:39 UTC

Are we running out of tasks? Only 750 tasks left

On the status page the gene_work_generator is also deactivated

pututu
Send message
Joined: 26 Nov 16
Posts: 5
Credit: 8,309,494
RAC: 101,072
United States
Message 2949 - Posted: 25 Oct 2022, 17:17:32 UTC - in response to Message 2948.

New tasks are still been generated but in smaller quantity than before. Total task in progress for the past 6 hours or so has been pretty constant at around 50K mark. Watch that number and see if it goes down/up over time to determine whether the volunteers are crunching much faster than the rate of new task been created and vice versa.

Jim1348
Send message
Joined: 29 Dec 16
Posts: 87
Credit: 21,013,002
RAC: 2,285
United States
Message 2950 - Posted: 26 Oct 2022, 0:02:07 UTC - in response to Message 2949.

It shows 0 now, though maybe a few are still being generated. And Rosetta is out too. It is time for me to convert another machine to Folding.

Retvari Zoltan
Send message
Joined: 31 Mar 20
Posts: 11
Credit: 33,557,692
RAC: 90,218
Hungary
Message 2951 - Posted: 26 Oct 2022, 9:49:35 UTC
Last modified: 26 Oct 2022, 9:49:49 UTC

As you can see on the left side of the server status page, the gene_work_generator is not running, hence no new work is generated.
The other components are running, so the completed workunits can be uploaded and validated.
Probably the project administrator intentionally stopped the work generator process, to reduce the workload on the (problematic) storage servers.
It would have been nice to announce it in the news feed before we notice the effect on our hosts.

Profile valterc
Project administrator
Project tester
Send message
Joined: 30 Oct 13
Posts: 560
Credit: 31,454,729
RAC: 13,731
Italy
Message 2952 - Posted: 26 Oct 2022, 14:13:04 UTC - in response to Message 2951.

Got a 'MySQL server has gone away' error, obviously unexpected. The work generator, in such cases, needs a manual kick-off... I did this as soon as I noticed it.

Kiska
Send message
Joined: 12 Mar 17
Posts: 1
Credit: 111,186
RAC: 288
Australia
Message 2953 - Posted: 26 Oct 2022, 16:01:57 UTC
Last modified: 26 Oct 2022, 16:02:21 UTC

Well the V-shaped recovery is underway



I estimate 24-36 hours based on the trend line

Retvari Zoltan
Send message
Joined: 31 Mar 20
Posts: 11
Credit: 33,557,692
RAC: 90,218
Hungary
Message 2954 - Posted: 26 Oct 2022, 17:37:01 UTC - in response to Message 2952.

Thank you.
Sorry for putting the blame on you, I didn't know about the SQL server anomaly.

Retvari Zoltan
Send message
Joined: 31 Mar 20
Posts: 11
Credit: 33,557,692
RAC: 90,218
Hungary
Message 2991 - Posted: 10 Nov 2022, 15:19:32 UTC

The work generator is not working.
My uploads are stuck.

Profile valterc
Project administrator
Project tester
Send message
Joined: 30 Oct 13
Posts: 560
Credit: 31,454,729
RAC: 13,731
Italy
Message 2992 - Posted: 10 Nov 2022, 15:39:03 UTC - in response to Message 2991.
Last modified: 10 Nov 2022, 15:52:44 UTC

Usual problem with the external file system becoming painfully slow. I stop the work generator and the uploading, from time to time, to mitigate the problem.

Previous · 1 · 2
Post to thread

Message boards : Number crunching : OUT of tasks


Main page · Your account · Message boards


Copyright © 2022 CNR-TN & UniTN