log in |
Message boards : Development : Disk space problem
Author | Message |
---|---|
Too much data is needed (transmitted to and stored on the client's local disk) for our project, this may raise big bandwidth and space problems. | |
ID: 213 · Reply Quote | |
There are two possible approaches: I'm not sure, but i think Rosetta@home uses the method numer 1 | |
ID: 217 · Reply Quote | |
As written some days ago in another post, I made some attempts of compressing the input files. With the current inputs, the best compression is of course lzma, but it takes way too much time to compress one file. bzip2 achieves almost the same compression ratio but it takes less time (in exchange of a big amount of memory, if I'm not wrong). The compressed file are ~38% of the original ones. | |
ID: 245 · Reply Quote | |
Ok, I made some experiments regarding substituting the csv input files with binary ones and here are the results. | |
ID: 247 · Reply Quote | |
Message boards :
Development :
Disk space problem