Error uploading results

Author	Message
BE02252 Send message Joined: 17 Jul 17 Posts: 2 Credit: 196,176 RAC: 0	Message 1347 - Posted: 30 Aug 2018, 8:09:27 UTC
Over the past weeks, I've had several workunits that can't be uploaded from my Linux Boinc client (7.6.31 x86_64). E.g. do 30 aug 2018 08:41:42 CEST \| TN-Grid Platform \| Started upload of 144580_Hs_T188475-LPAR1_wu-253_1535323582290_0_0 do 30 aug 2018 08:41:46 CEST \| \| Project communication failed: attempting access to reference site do 30 aug 2018 08:41:46 CEST \| TN-Grid Platform \| Temporarily failed upload of 144580_Hs_T188475-LPAR1_wu-253_1535323582290_0_0: transient HTTP error do 30 aug 2018 08:41:46 CEST \| TN-Grid Platform \| Backing off 03:01:37 on upload of 144580_Hs_T188475-LPAR1_wu-253_1535323582290_0_0 do 30 aug 2018 08:41:48 CEST \| \| Internet access OK - project servers may be temporarily down. At this moment I have 5 such results, and I've already canceled several others. But many results still upload without any problem. The units which fail upload are retried after a couple of hours, only to fail again - I've never seen any workunit which failed the first time to upload successfully afterwards. So while the log file seems to indicate a temporarily connection problem, it seems more like there is actually something wrong with the workunit itself. Is this a known problem? Anything I can do?
ID: 1347 · Reply Quote

valterc Project administrator Project tester Send message Joined: 30 Oct 13 Posts: 624 Credit: 34,677,535 RAC: 0	Message 1349 - Posted: 3 Sep 2018, 16:48:43 UTC - in response to Message 1347. Last modified: 3 Sep 2018, 16:54:43 UTC
You are the first user that recently reported about this kind of error. From what I can see, server side, there weren't issues. That's very strange. I need to further investigate. Anyway, thank you for the info. I just changed, increasing it, the timeout variable inside apache2.conf, hope this helps.
ID: 1349 · Reply Quote

Normalman Send message Joined: 29 Oct 22 Posts: 3 Credit: 1,652,939 RAC: 0	Message 3000 - Posted: 12 Nov 2022, 11:45:52 UTC - in response to Message 1349. Last modified: 12 Nov 2022, 11:55:57 UTC
I have the same problem for several days. Your server does not accept some of my completed tasks! No other projects have such issue, but only this project has! My BOINC client version: 7.20.2 for x86_64-pc-linux-gnu E.g. Sat 12 Nov 2022 18:43:54 WIB \| TN-Grid Platform \| Started upload of 222354_Hs_T174457-HOXA13_wu-185_1668218323496_1_0 Sat 12 Nov 2022 18:44:00 WIB \| TN-Grid Platform \| [error] Error reported by file upload server: [222354_Hs_T174457-HOXA13_wu-185_1668218323496_1_0] locked by file_upload_handler PID=-1 Sat 12 Nov 2022 18:44:00 WIB \| TN-Grid Platform \| Temporarily failed upload of 222354_Hs_T174457-HOXA13_wu-185_1668218323496_1_0: transient upload error Sat 12 Nov 2022 18:44:00 WIB \| TN-Grid Platform \| Backing off 00:12:17 on upload of 222354_Hs_T174457-HOXA13_wu-185_1668218323496_1_0 Sat 12 Nov 2022 18:41:26 WIB \| TN-Grid Platform \| Starting task 222368_Hs_T145528-PPBP_wu-286_1668241673616_0 Sat 12 Nov 2022 18:42:37 WIB \| \| Project communication failed: attempting access to reference site Sat 12 Nov 2022 18:42:37 WIB \| TN-Grid Platform \| Temporarily failed upload of 222357_Hs_T083890-FCRL5_wu-73_1668222489938_0_0: transient HTTP error Sat 12 Nov 2022 18:42:37 WIB \| TN-Grid Platform \| Backing off 00:02:01 on upload of 222357_Hs_T083890-FCRL5_wu-73_1668222489938_0_0 Sat 12 Nov 2022 18:42:37 WIB \| TN-Grid Platform \| Started upload of 222358_Hs_T083891-FCRL5_wu-241_1668224492012_0_0 Sat 12 Nov 2022 18:42:39 WIB \| \| Internet access OK - project servers may be temporarily down. Sat 12 Nov 2022 18:42:40 WIB \| TN-Grid Platform \| [error] Error reported by file upload server: [221903_Hs_T132668-SNORA63_wu-162_1668033374527_1_0] locked by file_upload_handler PID=-1 Sat 12 Nov 2022 18:42:40 WIB \| TN-Grid Platform \| Temporarily failed upload of 221903_Hs_T132668-SNORA63_wu-162_1668033374527_1_0: transient upload error Sat 12 Nov 2022 18:42:40 WIB \| TN-Grid Platform \| Backing off 03:48:37 on upload of 221903_Hs_T132668-SNORA63_wu-162_1668033374527_1_0 For now the list of my such tasks is: 220749_Hs_T157149-ASCC3_wu-277_1667877255837 221902_Hs_T132667-SNORA81_wu-134_1668032297991 221903_Hs_T132668-SNORA63_wu-162_1668033374527 221930_Hs_T099400-NOP56_wu-218_1668061643250 221938_Hs_T063682-LINC00338_wu-129_1668069752308 221938_Hs_T063682-LINC00338_wu-153_1668069806911 222006_Hs_snorna-ENSG00000200812_wu-8_1668087860812 220813_Hs_T073345-ARHGAP33_wu-25_1668189461819 222342_Hs_T051482-CREBBP_wu-284_1668192574608 222351_Hs_T088113-BTG2_wu-224_1668211256614
ID: 3000 · Reply Quote

valterc Project administrator Project tester Send message Joined: 30 Oct 13 Posts: 624 Credit: 34,677,535 RAC: 0	Message 3001 - Posted: 12 Nov 2022, 15:13:34 UTC - in response to Message 3000.
Our filesystem has some problems. I may try something in order to mitigate them but not before this Monday, while back in my office. Sorry about this.
ID: 3001 · Reply Quote

Normalman Send message Joined: 29 Oct 22 Posts: 3 Credit: 1,652,939 RAC: 0	Message 3002 - Posted: 12 Nov 2022, 17:46:23 UTC - in response to Message 3001.
OK, I'll be waiting .......
ID: 3002 · Reply Quote

Keith Myers Send message Joined: 26 Jun 20 Posts: 64 Credit: 15,299,594 RAC: 0	Message 3003 - Posted: 13 Nov 2022, 1:57:42 UTC
I too am having issues uploading finished results. Many hour backoffs and retry counts over 21 times attempted. ____________ A proud member of the OFA (Old Farts Association)
ID: 3003 · Reply Quote

Normalman Send message Joined: 29 Oct 22 Posts: 3 Credit: 1,652,939 RAC: 0	Message 3024 - Posted: 28 Nov 2022, 15:08:21 UTC - in response to Message 3001. Last modified: 28 Nov 2022, 15:11:17 UTC
The problem still exists! The server refuses to upload finished results of some tasks: Mon 28 Nov 2022 21:57:19 \| TN-Grid Platform \| Started upload of 223057_Hs_T045479-TRIP4_wu-107_1669236737159_0_0 Mon 28 Nov 2022 21:57:23 \| TN-Grid Platform \| [error] Error reported by file upload server: [223057_Hs_T045479-TRIP4_wu-107_1669236737159_0_0] locked by file_upload_handler PID=-1 Mon 28 Nov 2022 21:57:23 \| TN-Grid Platform \| Temporarily failed upload of 223057_Hs_T045479-TRIP4_wu-107_1669236737159_0_0: transient upload error Mon 28 Nov 2022 21:57:23 \| TN-Grid Platform \| Backing off 03:25:53 on upload of 223057_Hs_T045479-TRIP4_wu-107_1669236737159_0_0 Now I have 7 such tasks.
ID: 3024 · Reply Quote

Author

Message

BE02252
Send message
Joined: 17 Jul 17
Posts: 2
Credit: 196,176
RAC: 0
100,000 credits

Over the past weeks, I've had several workunits that can't be uploaded from my Linux Boinc client (7.6.31 x86_64).

E.g.
do 30 aug 2018 08:41:42 CEST | TN-Grid Platform | Started upload of 144580_Hs_T188475-LPAR1_wu-253_1535323582290_0_0
do 30 aug 2018 08:41:46 CEST | | Project communication failed: attempting access to reference site
do 30 aug 2018 08:41:46 CEST | TN-Grid Platform | Temporarily failed upload of 144580_Hs_T188475-LPAR1_wu-253_1535323582290_0_0: transient HTTP error
do 30 aug 2018 08:41:46 CEST | TN-Grid Platform | Backing off 03:01:37 on upload of 144580_Hs_T188475-LPAR1_wu-253_1535323582290_0_0
do 30 aug 2018 08:41:48 CEST | | Internet access OK - project servers may be temporarily down.

At this moment I have 5 such results, and I've already canceled several others. But many results still upload without any problem. The units which fail upload are retried after a couple of hours, only to fail again - I've never seen any workunit which failed the first time to upload successfully afterwards. So while the log file seems to indicate a temporarily connection problem, it seems more like there is actually something wrong with the workunit itself.

Is this a known problem? Anything I can do?

ID: 1347 · Reply Quote

valterc
Project administrator
Project tester
Send message
Joined: 30 Oct 13
Posts: 624
Credit: 34,677,535
RAC: 0

You are the first user that recently reported about this kind of error. From what I can see, server side, there weren't issues. That's very strange. I need to further investigate. Anyway, thank you for the info.

I just changed, increasing it, the timeout variable inside apache2.conf, hope this helps.

ID: 1349 · Reply Quote

Normalman

Send message
Joined: 29 Oct 22
Posts: 3
Credit: 1,652,939
RAC: 0
1,000,000 credits

I have the same problem for several days. Your server does not accept some of my completed tasks!

No other projects have such issue, but only this project has!
My BOINC client version: 7.20.2 for x86_64-pc-linux-gnu

E.g.

Sat 12 Nov 2022 18:43:54 WIB | TN-Grid Platform | Started upload of 222354_Hs_T174457-HOXA13_wu-185_1668218323496_1_0 Sat 12 Nov 2022 18:44:00 WIB | TN-Grid Platform | [error] Error reported by file upload server: [222354_Hs_T174457-HOXA13_wu-185_1668218323496_1_0] locked by file_upload_handler PID=-1 Sat 12 Nov 2022 18:44:00 WIB | TN-Grid Platform | Temporarily failed upload of 222354_Hs_T174457-HOXA13_wu-185_1668218323496_1_0: transient upload error Sat 12 Nov 2022 18:44:00 WIB | TN-Grid Platform | Backing off 00:12:17 on upload of 222354_Hs_T174457-HOXA13_wu-185_1668218323496_1_0

Sat 12 Nov 2022 18:41:26 WIB | TN-Grid Platform | Starting task 222368_Hs_T145528-PPBP_wu-286_1668241673616_0 Sat 12 Nov 2022 18:42:37 WIB | | Project communication failed: attempting access to reference site Sat 12 Nov 2022 18:42:37 WIB | TN-Grid Platform | Temporarily failed upload of 222357_Hs_T083890-FCRL5_wu-73_1668222489938_0_0: transient HTTP error Sat 12 Nov 2022 18:42:37 WIB | TN-Grid Platform | Backing off 00:02:01 on upload of 222357_Hs_T083890-FCRL5_wu-73_1668222489938_0_0

Sat 12 Nov 2022 18:42:37 WIB | TN-Grid Platform | Started upload of 222358_Hs_T083891-FCRL5_wu-241_1668224492012_0_0 Sat 12 Nov 2022 18:42:39 WIB | | Internet access OK - project servers may be temporarily down. Sat 12 Nov 2022 18:42:40 WIB | TN-Grid Platform | [error] Error reported by file upload server: [221903_Hs_T132668-SNORA63_wu-162_1668033374527_1_0] locked by file_upload_handler PID=-1 Sat 12 Nov 2022 18:42:40 WIB | TN-Grid Platform | Temporarily failed upload of 221903_Hs_T132668-SNORA63_wu-162_1668033374527_1_0: transient upload error Sat 12 Nov 2022 18:42:40 WIB | TN-Grid Platform | Backing off 03:48:37 on upload of 221903_Hs_T132668-SNORA63_wu-162_1668033374527_1_0

For now the list of my such tasks is:

ID: 3000 · Reply Quote

valterc
Project administrator
Project tester
Send message
Joined: 30 Oct 13
Posts: 624
Credit: 34,677,535
RAC: 0

Our filesystem has some problems. I may try something in order to mitigate them but not before this Monday, while back in my office.
Sorry about this.

ID: 3001 · Reply Quote

Normalman

Send message
Joined: 29 Oct 22
Posts: 3
Credit: 1,652,939
RAC: 0
1,000,000 credits

OK, I'll be waiting .......

ID: 3002 · Reply Quote

Keith Myers
Send message
Joined: 26 Jun 20
Posts: 64
Credit: 15,299,594
RAC: 0

I too am having issues uploading finished results. Many hour backoffs and retry counts over 21 times attempted.
____________

A proud member of the OFA (Old Farts Association)

ID: 3003 · Reply Quote

Normalman

Send message
Joined: 29 Oct 22
Posts: 3
Credit: 1,652,939
RAC: 0
1,000,000 credits

The problem still exists!

The server refuses to upload finished results of some tasks:

Mon 28 Nov 2022 21:57:19 | TN-Grid Platform | Started upload of 223057_Hs_T045479-TRIP4_wu-107_1669236737159_0_0 Mon 28 Nov 2022 21:57:23 | TN-Grid Platform | [error] Error reported by file upload server: [223057_Hs_T045479-TRIP4_wu-107_1669236737159_0_0] locked by file_upload_handler PID=-1 Mon 28 Nov 2022 21:57:23 | TN-Grid Platform | Temporarily failed upload of 223057_Hs_T045479-TRIP4_wu-107_1669236737159_0_0: transient upload error Mon 28 Nov 2022 21:57:23 | TN-Grid Platform | Backing off 03:25:53 on upload of 223057_Hs_T045479-TRIP4_wu-107_1669236737159_0_0

Now I have 7 such tasks.

ID: 3024 · Reply Quote