Storage problem
log in

Advanced search

Message boards : News : Storage problem

Author Message
Profile valterc
Project administrator
Project tester
Send message
Joined: 30 Oct 13
Posts: 518
Credit: 27,314,189
RAC: 6,860
Italy
Message 2384 - Posted: 14 Oct 2021, 11:35:54 UTC
Last modified: 14 Oct 2021, 14:26:09 UTC

The University's storage system (that we heavily use) is having big performance issues thus everything is painfully slow. I stopped the work generator, which actually was not working because of this. No new tasks will be generated until the assimilator will be able to move the finished results to the proper place. There is nothing else to do but wait until the problem will be solved, no ETA, unfortunately.

Profile adrianxw
Send message
Joined: 22 Dec 16
Posts: 25
Credit: 5,490,656
RAC: 7,300
Denmark
Message 2385 - Posted: 14 Oct 2021, 14:23:16 UTC - in response to Message 2384.

Most crunchers attatch several projects to a computing node, so if one, or more, temporarily, stops producing work, their machines happily move onto other projects. Nice of you to let us know though.

It would be interesting to know what kind of systems, (processors, RAM, disk capacity, communications etc.), are used to run a project.
____________
Wave upon wave of demented avengers march cheerfully out of obscurity into the dream.

Profile valterc
Project administrator
Project tester
Send message
Joined: 30 Oct 13
Posts: 518
Credit: 27,314,189
RAC: 6,860
Italy
Message 2386 - Posted: 15 Oct 2021, 15:22:21 UTC - in response to Message 2385.

Well, I really don't know what's behind the University storage system (hardware, configuration, etc.), we just use it :)
BTW, it seems that the system is slowly recovering, when the numbers in the project status page will be close to zero I will try to start the work generator again and see if it will work as usual.

Gunnar Hjern
Send message
Joined: 29 Mar 17
Posts: 14
Credit: 12,214,366
RAC: 3,777
Sweden
Message 2387 - Posted: 15 Oct 2021, 17:28:49 UTC - in response to Message 2386.

Good news!!!
Really looking forward to that, as my computers are starting to get very hungry now! :-)

Btw., I can see that there where no stats exported to BoincStats today. Is that issue also related to the failing storage system?

Aurum
Send message
Joined: 18 Jul 18
Posts: 61
Credit: 130,708,819
RAC: 0
United States
Message 2388 - Posted: 16 Oct 2021, 13:46:02 UTC

Can we donate our GRC so you can buy your own storage node?

Profile valterc
Project administrator
Project tester
Send message
Joined: 30 Oct 13
Posts: 518
Credit: 27,314,189
RAC: 6,860
Italy
Message 2391 - Posted: 18 Oct 2021, 9:08:12 UTC - in response to Message 2387.

Good news!!!
Really looking forward to that, as my computers are starting to get very hungry now! :-)

Btw., I can see that there where no stats exported to BoincStats today. Is that issue also related to the failing storage system?

I had also to stop all the BOINC's server cron activities...

Profile valterc
Project administrator
Project tester
Send message
Joined: 30 Oct 13
Posts: 518
Credit: 27,314,189
RAC: 6,860
Italy
Message 2394 - Posted: 25 Oct 2021, 22:25:04 UTC - in response to Message 2391.

We are still facing the "storage" problem. Everything, sometimes, is painfully slow (I temporarily disabled the work generator)

Profile Keith Myers
Send message
Joined: 26 Jun 20
Posts: 37
Credit: 4,039,680
RAC: 8,604
United States
Message 2405 - Posted: 10 Nov 2021, 1:14:09 UTC - in response to Message 2394.

Any recent news from the university on their storage problem?

I've never been out of work on this project till now.

Profile valterc
Project administrator
Project tester
Send message
Joined: 30 Oct 13
Posts: 518
Credit: 27,314,189
RAC: 6,860
Italy
Message 2406 - Posted: 10 Nov 2021, 18:20:36 UTC - in response to Message 2405.
Last modified: 16 Nov 2021, 16:43:05 UTC

Any recent news from the university on their storage problem?

I've never been out of work on this project till now.

They are working on it, but it seems that they don't know the origin of the problem. A new storage system has been ordered but delayed due to legal issues....

I will wait until the end of this week, then I will try to switch from the NFS UniTN storage to a local one (not that big but reliable). It will unfortunately take some time to do that, every file operation affecting that storage is painfully slow...

In the meantime you may see the work generator working, from time to time

[EDIT] It seems that people of UniTN were able to fix the storage problem. Let's hope it lasts.

kotenok2000
Send message
Joined: 18 Feb 20
Posts: 2
Credit: 106,492
RAC: 1,154
Russia
Message 2414 - Posted: 24 Nov 2021, 22:28:12 UTC - in response to Message 2406.

I can't get any workunits.

Falconet
Send message
Joined: 21 Dec 16
Posts: 54
Credit: 970,773
RAC: 252
Portugal
Message 2415 - Posted: 24 Nov 2021, 23:04:53 UTC - in response to Message 2414.
Last modified: 24 Nov 2021, 23:05:00 UTC

Work generator is down and there are no tasks ready to send.

Nothing to do but wait.
____________

Profile Keith Myers
Send message
Joined: 26 Jun 20
Posts: 37
Credit: 4,039,680
RAC: 8,604
United States
Message 2416 - Posted: 25 Nov 2021, 0:35:26 UTC

Seems to be storage server issues again. Keep getting backed off on uploads.

kotenok2000
Send message
Joined: 18 Feb 20
Posts: 2
Credit: 106,492
RAC: 1,154
Russia
Message 2418 - Posted: 25 Nov 2021, 0:38:52 UTC - in response to Message 2417.

And doubleposting problems

Profile valterc
Project administrator
Project tester
Send message
Joined: 30 Oct 13
Posts: 518
Credit: 27,314,189
RAC: 6,860
Italy
Message 2419 - Posted: 25 Nov 2021, 10:36:29 UTC - in response to Message 2417.

Seems to be storage server issues again. Keep getting backed off on uploads.

Yes, again... Unfortunately I don't know any other detail, yet...


Post to thread

Message boards : News : Storage problem


Main page · Your account · Message boards


Copyright © 2021 CNR-TN & UniTN