log in |
Message boards : Development : Application group request (compact stderr)
Author | Message |
---|---|
Please try to make the stderr output more compact. From #132 Tue Dec 24 02:05:01 2013to something like 132|13-12-24 02:05:01|G F S|C(9:2223)I mean, all the needed info squeezed in few bytes. Also, do you need to read the complete_gene_net at every iteration? Shouldn't be more efficient to just read it at start or returning from checkpoint and keep it (or a copy of it) in memory? | |
ID: 239 · Reply Quote | |
Please try to make the stderr output more compact. From I did not work on that, but I think that the new version we already sent has a more compact stderr. Also, do you need to read the complete_gene_net at every iteration? Shouldn't be more efficient to just read it at start or returning from checkpoint and keep it (or a copy of it) in memory? When we developed the first versions of the application, we had no bounds on the complete_gene size, so the best strategy was to read on-the-fly the lines needed. I think that we should discuss this with professor Blanzieri, reading it once should be faster, but I suspect that working with different species could lead to far bigger input files, compared to the Arabidopsis. Splitting those files may be a solution, though.. ____________ Paolo - Application team dev (SSC11) "If you were plowing a field, which would you rather use: two strong oxen or 1024 chickens?" Seymour Cray | |
ID: 241 · Reply Quote | |
Please try to make the stderr output more compact. From Yes, the new application version have a more compact stderr with timestamp! Also, do you need to read the complete_gene_net at every iteration? Shouldn't be more efficient to just read it at start or returning from checkpoint and keep it (or a copy of it) in memory? We cannot read and store all in ram. For arabidopsis, that is a small genome, we calculated that the ram needed will be around 8 GB! | |
ID: 243 · Reply Quote | |
I've computed some wus with the new application... There are still a thousand lines in the stderr with 500 tiles, but I think that the lines printed are necessary for future debug! | |
ID: 252 · Reply Quote | |
Message boards :
Development :
Application group request (compact stderr)