No available WU
log in

Advanced search

Message boards : Number crunching : No available WU

Author Message
Profile [PUGLIA] kidkidkid3
Send message
Joined: 2 May 14
Posts: 2
Credit: 1,785,289
RAC: 0
Italy
Message 903 - Posted: 11 Feb 2017, 10:45:00 UTC

Hi,
from today (about 9.35 a.m.) the wu queue is empty.
I'll "switch" my pc for some hours.
Thanks
K.

Profile valterc
Project administrator
Project tester
Send message
Joined: 30 Oct 13
Posts: 320
Credit: 16,266,886
RAC: 4,430
Italy
Message 904 - Posted: 11 Feb 2017, 12:21:42 UTC - in response to Message 903.

Hi,
from today (about 9.35 a.m.) the wu queue is empty.
I'll "switch" my pc for some hours.
Thanks
K.

We have to move 'slowly' during this weekend. Until we fix the 'too big output file' issue the system needs a lot of micro-management. I hope that at beginning of the next week we'll be able to solve this problem.
Thanks all for your understanding.

jnamath
Send message
Joined: 14 Jan 17
Posts: 5
Credit: 1,002,528
RAC: 0
Germany
Message 912 - Posted: 14 Feb 2017, 16:33:33 UTC

Hi, will you post here when the issue is fixed?
I'd move my crunch boxes back to tn-grid then...

Cheers
Holger
____________
My stats

Profile valterc
Project administrator
Project tester
Send message
Joined: 30 Oct 13
Posts: 320
Credit: 16,266,886
RAC: 4,430
Italy
Message 913 - Posted: 14 Feb 2017, 17:31:20 UTC - in response to Message 912.
Last modified: 14 Feb 2017, 17:31:39 UTC

Hi, will you post here when the issue is fixed?
I'd move my crunch boxes back to tn-grid then...

Cheers
Holger

Yes, certainly, I will make an official announcement (news)

Profile valterc
Project administrator
Project tester
Send message
Joined: 30 Oct 13
Posts: 320
Credit: 16,266,886
RAC: 4,430
Italy
Message 914 - Posted: 15 Feb 2017, 12:14:17 UTC - in response to Message 913.
Last modified: 15 Feb 2017, 12:15:05 UTC

We are almost done writing the new application. We had to make a new one because changing the output file format implies that there would be no cross-validation between results made by this and the old one (a simple version change don't work in this cases)
We are testing it locally, we will keep you all updated.

Profile Daniel
Volunteer developer
Send message
Joined: 19 Oct 16
Posts: 78
Credit: 2,202,886
RAC: 0
Poland
Message 915 - Posted: 15 Feb 2017, 12:35:57 UTC - in response to Message 914.

We are almost done writing the new application. We had to make a new one because changing the output file format implies that there would be no cross-validation between results made by this and the old one (a simple version change don't work in this cases)
We are testing it locally, we will keep you all updated.

I recall that some projects which wanted to update app to new version which was not compatible with old one decided to stop generating new WUs and wait until all existing WUs were validated, then rolled out new app version. Your WUs have quite short deadline, maybe it would be worth to wait a few days more until all (or most) of existing WUs will be returned?
____________

Profile valterc
Project administrator
Project tester
Send message
Joined: 30 Oct 13
Posts: 320
Credit: 16,266,886
RAC: 4,430
Italy
Message 916 - Posted: 15 Feb 2017, 15:15:13 UTC - in response to Message 915.
Last modified: 15 Feb 2017, 15:19:58 UTC

We are almost done writing the new application. We had to make a new one because changing the output file format implies that there would be no cross-validation between results made by this and the old one (a simple version change don't work in this cases)
We are testing it locally, we will keep you all updated.

I recall that some projects which wanted to update app to new version which was not compatible with old one decided to stop generating new WUs and wait until all existing WUs were validated, then rolled out new app version. Your WUs have quite short deadline, maybe it would be worth to wait a few days more until all (or most) of existing WUs will be returned?

yes, this is also a solution, but the best one (without waiting times) is to have for some days both applications running (validator and assimilator are the same), stopping the 'old' work generator. When all the 'old' workunits are back I can simply remove the old application.

This way is also easier to deal with people running the 'old' anonymous platform, they will simply receive no new work (and will notice it) until they switch back to their default platform.

LennStar
Send message
Joined: 16 Jan 17
Posts: 1
Credit: 2,699,002
RAC: 10,411
Message 921 - Posted: 22 Feb 2017, 18:19:58 UTC

So the reason it is hard to get new WU is not that there are no new ones, but that there are not enough because the work creator is too slow?

Profile valterc
Project administrator
Project tester
Send message
Joined: 30 Oct 13
Posts: 320
Credit: 16,266,886
RAC: 4,430
Italy
Message 922 - Posted: 23 Feb 2017, 10:21:59 UTC - in response to Message 921.
Last modified: 23 Feb 2017, 12:12:22 UTC

So the reason it is hard to get new WU is not that there are no new ones, but that there are not enough because the work creator is too slow?

We have plenty of work to do and workunits to distribute. The work generator is slow, we may solve this problem either rewriting it or upgrading our hardware (this isn't so easy). Right now we are able to prepare around 170 workunits (times two, for redundancy) in about 8 minutes. A workunit may return in around 20-25 minutes, so it's almost impossible to build up a large queue. A fix would be to build up larger workunits (with average running time of more than 60-90 minutes) but we cannot do this until we fix the 'too big' output file issue. This is a problem for users with limited bandwidth but also for us having to micro-manage our whole storage system.

We are working to find a reliable solution. Thank you for your understanding.

Profile KPX
Send message
Joined: 9 Dec 14
Posts: 4
Credit: 503,776
RAC: 3
Czech Republic
Message 923 - Posted: 24 Feb 2017, 11:54:24 UTC - in response to Message 922.

...
We have plenty of work to do and workunits to distribute. The work generator is slow, we may solve this problem either rewriting it or upgrading our hardware (this isn't so easy). Right now we are able to prepare around 170 workunits (times two, for redundancy) in about 8 minutes. A workunit may return in around 20-25 minutes, so it's almost impossible to build up a large queue. A fix would be to build up larger workunits (with average running time of more than 60-90 minutes) but we cannot do this until we fix the 'too big' output file issue. This is a problem for users with limited bandwidth but also for us having to micro-manage our whole storage system...

Very nice and clear explanation. Thank you! And best of luck in finding the solution soon! :-)

meral
Send message
Joined: 11 Jan 17
Posts: 1
Credit: 507,592
RAC: 0
Germany
Message 924 - Posted: 24 Feb 2017, 15:54:33 UTC - in response to Message 922.
Last modified: 24 Feb 2017, 16:20:27 UTC

... A workunit may return in around 20-25 minutes, so it's almost impossible to build up a large queue. A fix would be to build up larger workunits (with average running time of more than 60-90 minutes)...


On my i7 7700k it takes around 10-14 minutes per WU with HT on so one WU per 1-2 minutes if all threats are used. The 2600K is still half as fast. realy looking forward to the "new" WU´s ;)

keep up the good work. The increase of efficiency was huge over the last month so its no surprise the WU´s are "eaten" faster than produced at the moment.

Mercosity
Send message
Joined: 17 Jan 17
Posts: 12
Credit: 542,773
RAC: 0
Ireland
Message 926 - Posted: 1 Mar 2017, 11:09:46 UTC
Last modified: 1 Mar 2017, 11:15:07 UTC

Is there any particular reason why there are no wus?

I know there was an explanation that they may be longer and I can understand that.

We are dedicated so it shouldn't be a problem. Why not more credit if they are longer?

Profile valterc
Project administrator
Project tester
Send message
Joined: 30 Oct 13
Posts: 320
Credit: 16,266,886
RAC: 4,430
Italy
Message 927 - Posted: 1 Mar 2017, 18:49:41 UTC - in response to Message 926.
Last modified: 1 Mar 2017, 18:49:54 UTC

Is there any particular reason why there are no wus?

I know there was an explanation that they may be longer and I can understand that.

We are dedicated so it shouldn't be a problem. Why not more credit if they are longer?

Very briefly, I have to limit the number of wu because of storage problems. We are waiting for a new application with a way smaller output file, this will hopefully solve the problem...

No.15
Send message
Joined: 2 Feb 16
Posts: 13
Credit: 64,229,764
RAC: 2,839
United States
Message 930 - Posted: 2 Mar 2017, 15:15:54 UTC - in response to Message 927.

Is there any particular reason why there are no wus?

I know there was an explanation that they may be longer and I can understand that.

We are dedicated so it shouldn't be a problem. Why not more credit if they are longer?

Very briefly, I have to limit the number of wu because of storage problems. We are waiting for a new application with a way smaller output file, this will hopefully solve the problem...

Do you have an approximate time frame for the new app? To many of my machines are idle :)

Mercosity
Send message
Joined: 17 Jan 17
Posts: 12
Credit: 542,773
RAC: 0
Ireland
Message 947 - Posted: 13 Mar 2017, 10:36:14 UTC

We need some communication here, please.

DigiK-oz
Send message
Joined: 7 Nov 16
Posts: 5
Credit: 1,490,894
RAC: 809
Netherlands
Message 948 - Posted: 13 Mar 2017, 12:02:30 UTC - in response to Message 947.

See the news section : http://gene.disi.unitn.it/test/forum_thread.php?id=162


Post to thread

Message boards : Number crunching : No available WU


Main page · Your account · Message boards


Copyright © 2017 CNR-TN & UniTN