File size too big error
log in

Advanced search

Message boards : Number crunching : File size too big error

Author Message
jnamath
Send message
Joined: 14 Jan 17
Posts: 5
Credit: 5,038,285
RAC: 0
Germany
Message 872 - Posted: 7 Feb 2017, 5:53:13 UTC

Hi,

since the introduction of the new V0.11 applications, I have been getting a lot of computation errors. Calculation seems alright, but on upload, there is a "filesize too big error".

Thanks
Holger

sorcrosc
Volunteer developer
Send message
Joined: 19 Dec 13
Posts: 26
Credit: 3,866,632
RAC: 0
Italy
Message 874 - Posted: 7 Feb 2017, 8:55:49 UTC

It seems a problem with vv workunits. I found one too:
http://gene.disi.unitn.it/test/result.php?resultid=6650470

Profile valterc
Project administrator
Project tester
Send message
Joined: 30 Oct 13
Posts: 616
Credit: 34,514,943
RAC: 395
Italy
Message 875 - Posted: 7 Feb 2017, 10:45:03 UTC - in response to Message 874.

It seems a problem with vv workunits. I found one too:
http://gene.disi.unitn.it/test/result.php?resultid=6650470

Ok, my fault, I need to change the "max_nbytes" parameter somewhere in the work generator. I'm just canceling all the vv affected workunits.

jnamath
Send message
Joined: 14 Jan 17
Posts: 5
Credit: 5,038,285
RAC: 0
Germany
Message 876 - Posted: 7 Feb 2017, 11:07:55 UTC

As of today, I have produced over 50 errors in the last 2 days - they are present for 3 of 4 hosts I'm running. The last one is a Raspberry Pi that has not completed any V0.11 WUs yet.

Checking the units of one host:
http://gene.disi.unitn.it/test/results.php?hostid=4378&offset=0&show_names=0&state=6&appid=

All of the invalid are Vv_vwm tasks. All of the recent valid WUs are Ec_ecm tasks...

Cheers
Holger
____________
My stats

Profile valterc
Project administrator
Project tester
Send message
Joined: 30 Oct 13
Posts: 616
Credit: 34,514,943
RAC: 395
Italy
Message 877 - Posted: 7 Feb 2017, 12:23:57 UTC - in response to Message 876.

As of today, I have produced over 50 errors in the last 2 days - they are present for 3 of 4 hosts I'm running. The last one is a Raspberry Pi that has not completed any V0.11 WUs yet.

Checking the units of one host:
http://gene.disi.unitn.it/test/results.php?hostid=4378&offset=0&show_names=0&state=6&appid=

All of the invalid are Vv_vwm tasks. All of the recent valid WUs are Ec_ecm tasks...

Cheers
Holger

The Ec workunits were easy to manage: relatively long computation time and small output file, the opposite happens with Vv. Ec (Escherichia coli) has only ~4000 genes while Vv (Vitis Vinifera) more than 28000. So we are trying to balance this in order to achieve the optimal workunit size. (the upload error was obviously not expected, our fault, sorry).

jnamath
Send message
Joined: 14 Jan 17
Posts: 5
Credit: 5,038,285
RAC: 0
Germany
Message 878 - Posted: 7 Feb 2017, 12:52:11 UTC - in response to Message 877.

Thanks a lot for the information - so the errors are not due to the V0.11 application, but due to WU size on the new project.
BR
____________
My stats

Profile valterc
Project administrator
Project tester
Send message
Joined: 30 Oct 13
Posts: 616
Credit: 34,514,943
RAC: 395
Italy
Message 879 - Posted: 7 Feb 2017, 14:11:30 UTC - in response to Message 878.
Last modified: 7 Feb 2017, 14:12:03 UTC

Thanks a lot for the information - so the errors are not due to the V0.11 application, but due to WU size on the new project.
BR

Exactly (the size of the output file)

Profile Beyond
Avatar
Send message
Joined: 2 Nov 16
Posts: 50
Credit: 44,191,036
RAC: 156
United States
Message 883 - Posted: 8 Feb 2017, 23:39:33 UTC - in response to Message 877.

The Ec workunits were easy to manage: relatively long computation time and small output file, the opposite happens with Vv. Ec (Escherichia coli) has only ~4000 genes while Vv (Vitis Vinifera) more than 28000. So we are trying to balance this in order to achieve the optimal workunit size. (the upload error was obviously not expected, our fault, sorry).

Could you make a choice in project preferences to choose the WU type? Some of us (read: 1/2 of the USA) have stone age broadband (a misnomer) speeds and can't handle these large uploads for short runtime WUs. I've had to cut way back because of this.


Post to thread

Message boards : Number crunching : File size too big error


Main page · Your account · Message boards


Copyright © 2024 CNR-TN & UniTN