valtercProject administrator
Project tester
Send message
Joined: 30 Oct 13
Posts: 623
Credit: 34,677,535
RAC: 132
A new version of the application, that should have no more suspend/checkpoint problems, has been released. Please test it thoroughly.
Reply
Quote
Some points on new app version (5 time longer).
1) I downloaded a lot of 70mb files
2) Report files is 5/6 mb
3) Most wus is between 80 to 100 minutes, but i have some wus with 8h estimated time. I'm running one of those and after 2h is at 10%....
Buon Natale!!
Reply
Quote
I'm running a 10h WUs too!
The work generator only divide the work considering the number of PC row; it does not consider the number of columns in the row, hence the complexity of the task can vary a bit.
The estimation algorithm, instead, takes in account also the number of columns.
In the future we should discuss with the pre-processing group in order to understand whether we can rely on some fixed size (up to a certain point) input file or not. If the input files has a large variability it will be probably necessary to modify the work generator in order to have WUs around 3-4hrs.
Merry Christmas, everyone!
Reply
Quote
Some points on new app version (5 time longer).
1) I downloaded a lot of 70mb files
The random_xx.csv files are bigger than 100 mb....
Reply
Quote