Storage problem
log in

Advanced search

Message boards : News : Storage problem

Previous · 1 · 2
Author Message
Profile adrianxw
Send message
Joined: 22 Dec 16
Posts: 28
Credit: 8,220,163
RAC: 2,177
Denmark
Message 2566 - Posted: 28 Feb 2022, 14:38:40 UTC
Last modified: 28 Feb 2022, 15:09:55 UTC

I asked earlier about the equipment necessary to run a project, you basically didn't know. I am puzzled, you now say you have found another disk. The reason I am nagging on about this, is that I added a new Samsung 870 EVO 2.5 500GB SSD to this machine earlier this year. The cost was trivial. >edit< It cost 529 Danish Kroner.
____________
Wave upon wave of demented avengers march cheerfully out of obscurity into the dream.

Profile valterc
Project administrator
Project tester
Send message
Joined: 30 Oct 13
Posts: 564
Credit: 32,194,927
RAC: 13,002
Italy
Message 2569 - Posted: 28 Feb 2022, 16:06:40 UTC - in response to Message 2566.
Last modified: 28 Feb 2022, 16:20:46 UTC

The issue here is not about the server itself, which, by the way, is not very powerful but is working. The problem is the *big* University storage system that we heavily use (I don't know the technical specs of it)
The complete expansion of a single human gene (input file, output files etc.) is ~385Mb (compressed). Just for the human genome dataset we have already expanded around 57000 of them. I let you do the math ;)
Most of the disk storage that we use is obviously just for keeping the history. The needed "live" storage for running the server is about 4-8 terabytes.
So, what we need in order to be independent of the University's storage system is something like, at minimum, 2x 4TB (Raid 0), for example two 3.84TB SSD SAS Read Intensive 12Gbps 2.5in Hot-plug. Please check the prices https://www.dell.com/en-us/shop/384tb-ssd-sas-read-intensive-12gbps-512e-25in-pm6-hot-plug/apd/345-bbxy/storage-drives-media
We simply don't have that money....

Profile adrianxw
Send message
Joined: 22 Dec 16
Posts: 28
Credit: 8,220,163
RAC: 2,177
Denmark
Message 2571 - Posted: 28 Feb 2022, 20:10:12 UTC
Last modified: 28 Feb 2022, 20:33:31 UTC

I have asked what...

2x 8TB (Raid 0), for example two 3.84TB SSD SAS Read Intensive 12Gbps 2.5in Hot-plug

... that would cost from Samsung, who supply my SSD's. Their chat type person was useless and directed me to their local office. I can ask them in the morning.

Two 3.84TB SSD is, of course, not going to give you 2x 8TB....
____________
Wave upon wave of demented avengers march cheerfully out of obscurity into the dream.

Profile adrianxw
Send message
Joined: 22 Dec 16
Posts: 28
Credit: 8,220,163
RAC: 2,177
Denmark
Message 2573 - Posted: 2 Mar 2022, 12:51:18 UTC

... and to date, I have yet to receive a reply which actually answered my question. Their marketing junk is pretty voluminous though...
Has the price of your current preferred solution just taken a series kick up?
____________
Wave upon wave of demented avengers march cheerfully out of obscurity into the dream.

Greg_BE
Send message
Joined: 22 Feb 22
Posts: 5
Credit: 247,676
RAC: 838
Belgium
Message 2577 - Posted: 6 Mar 2022, 13:29:27 UTC
Last modified: 6 Mar 2022, 13:42:45 UTC

Not much better price here in Belgium.
Also 4,000+

Are you guys allowed to do fund raising at all?

SiDock has a page for normal currency and crypto currency as well.
If everyone on here (volunteers with computers) would put in say 10 Euro (or equivalent in their currency)you would be able to solve your problem quickly.
If each user on this project gave 10 euro you would be able to upgrade with no problem.

Something to ask the administration about.

Jim1348
Send message
Joined: 29 Dec 16
Posts: 87
Credit: 21,013,002
RAC: 15
United States
Message 2578 - Posted: 6 Mar 2022, 15:13:51 UTC

Amazon could have it to you in a few days in the U.S.
I don't know about the EU.
https://www.amazon.com/Dell-3-84TB-Read-Intensive-12GBPS/dp/B089FKJ5X9/ref=sr_1_4

kotenok2000
Send message
Joined: 18 Feb 20
Posts: 3
Credit: 125,416
RAC: 0
Russia
Message 2579 - Posted: 6 Mar 2022, 15:18:16 UTC - in response to Message 2578.

It is out of stock.

Greg_BE
Send message
Joined: 22 Feb 22
Posts: 5
Credit: 247,676
RAC: 838
Belgium
Message 2580 - Posted: 6 Mar 2022, 16:32:08 UTC

Anything bought outside of the EU is subject to country tax plus customs fees.
So there is a unit in the US for $1,427 (1303 Euros), but then you add tax (in Belgium its 21%) so that's 1576 + 15 in customs fees, which brings it up to 1592 (rounded up) plus shipping costs from the US if they ship to Europe. That is less than the 4,000 Euros, but it includes a lot of if's and the warranty would be a US warranty and the drive if it had problems would have to go back to the US to be fixed.

So it is better to keep it in the EU. Costs will be higher, but the EU guarantee applies.

The drives here are exactly the model listed, just refurbished and under 1,000 Euro from Denmark: https://www.kimbrer.com/dell-tp4w3.html?srsltid=8981b0caf285434f8821256b4be70a58

Retvari Zoltan
Send message
Joined: 31 Mar 20
Posts: 12
Credit: 38,169,633
RAC: 94,818
Hungary
Message 3019 - Posted: 23 Nov 2022, 23:56:32 UTC
Last modified: 23 Nov 2022, 23:57:43 UTC

There are 18502 tasks ready to send. I haven't seen that many in the last month.
Has the storage problem been solved?

Profile valterc
Project administrator
Project tester
Send message
Joined: 30 Oct 13
Posts: 564
Credit: 32,194,927
RAC: 13,002
Italy
Message 3020 - Posted: 24 Nov 2022, 10:24:24 UTC - in response to Message 3019.

There are 18502 tasks ready to send. I haven't seen that many in the last month.
Has the storage problem been solved?

No, the problem has not yet solved, the file system still remains unreliable, sometimes it works well, sometimes not. Anyway, the people at UniTN told me that before the end of the year the new one will be available. In that case I will probably need to stop the server for a couple of days, I obviously will put a note into the news.

Previous · 1 · 2
Post to thread

Message boards : News : Storage problem


Main page · Your account · Message boards


Copyright © 2023 CNR-TN & UniTN