Optimization
log in

Advanced search

Message boards : Number crunching : Optimization

Previous · 1 . . . 5 · 6 · 7 · 8 · 9 · 10 · Next
Author Message
Profile Daniel
Volunteer developer
Send message
Joined: 19 Oct 16
Posts: 80
Credit: 2,202,886
RAC: 0
Poland
Message 1034 - Posted: 9 Apr 2017, 17:59:59 UTC - in response to Message 1033.

New app version is ready! It is available at the same place as usual: https://bitbucket.org/sirzooro/pc-boinc/downloads/. In order to install it, do following steps:
- finish or abort all existing tasks (they will be aborted after install automatically);
- stop BOINC;
- unpack selected version to project's directory (path like C:\Users\All Users\BOINC\projects\gene.disi.unitn.it_test\ on Windows, and /var/lib/boinc-client/projects/gene.disi.unitn.it_test on Linux);
- start BOINC again
After doing this, app name should change to "Gene Network Application (Opti v1.2)". You should also see message "Found app_info.xml; using anonymous platform" in event log for TN-Grid project.

I did all that, using the SSE2 version for Linux on my i7-4770, and got that message on reboot. But I am getting only errors.
http://gene.disi.unitn.it/test/results.php?hostid=6148

Error is "Permission denied". You need to execute following commands from root account in project dir to set appropriate permissions. If you cannot switch to root account using "su -", add "sudo " before each command.

chmod 755 pc chown boinc.boinc pc


After you do this, app should start working. You do not need to restart BOINC again.
____________

Jim1348
Send message
Joined: 29 Dec 16
Posts: 6
Credit: 144,359
RAC: 0
United States
Message 1035 - Posted: 9 Apr 2017, 18:36:57 UTC - in response to Message 1034.
Last modified: 9 Apr 2017, 18:47:00 UTC

OK, I did that, but now get the message:

Message from server: Your app_info.xml file doesn't have a usable version of gene@home PC-IM.


EDIT:
Also, it won't download more work, since it says the computer has reached the daily quota of 1 task.

Gunde
Send message
Joined: 7 Dec 16
Posts: 8
Credit: 20,880,133
RAC: 844
Sweden
Message 1036 - Posted: 9 Apr 2017, 19:09:42 UTC
Last modified: 9 Apr 2017, 19:17:08 UTC

Win10 X64
PC-IM v1.02 (sse2) 1600-1700 sec range with i7-5820k 4.2GHz
v1.2 SSE2 1750-1755 sec range

Linux X64 ubuntu 16.10LTS PC-IM v1.03 (fma) 2200-2250 sec average with xeon 2696 v3
v.1.2 (fma) 1940-1980 sec range

Same instruction to compare but different to system/os. So for these win took longer but linux shorter.

Profile Daniel
Volunteer developer
Send message
Joined: 19 Oct 16
Posts: 80
Credit: 2,202,886
RAC: 0
Poland
Message 1037 - Posted: 9 Apr 2017, 19:18:59 UTC - in response to Message 1035.
Last modified: 9 Apr 2017, 19:20:18 UTC

OK, I did that, but now get the message:

Message from server: Your app_info.xml file doesn't have a usable version of gene@home PC-IM.


EDIT:
Also, it won't download more work, since it says the computer has reached the daily quota of 1 task.

I suspect that problem is caused by WUs which you downloaded using official app, which are still considered as in progress. Please try to delete app_info.xml, restart BOINC, wait until BOINC will re-download all these WUs, then abort them all and install optimized app again. Before aborting tasks please also suspend project or set it to "no new tasks" to avoid downloading new WUs in place of aborted ones.

BTW, i7-4770 also supports AVX and FMA, you can try these app versions too.
____________

Profile Daniel
Volunteer developer
Send message
Joined: 19 Oct 16
Posts: 80
Credit: 2,202,886
RAC: 0
Poland
Message 1038 - Posted: 9 Apr 2017, 19:43:01 UTC - in response to Message 1036.

Win10 X64
PC-IM v1.02 (sse2) 1600-1700 sec range with i7-5820k 4.2GHz
v1.2 SSE2 1750-1755 sec range

Linux X64 ubuntu 16.10LTS PC-IM v1.03 (fma) 2200-2250 sec average with xeon 2696 v3
v.1.2 (fma) 1940-1980 sec range

Same instruction to compare but different to system/os. So for these win took longer but linux shorter.

Thanks for these numbers. I did my tests on Windows using AVX version and it was faster for me. I suspect that new SSE version is slower. but I have to perform additional tests to confirm this. I will let you know when I will have some results.
____________

Profile Daniel
Volunteer developer
Send message
Joined: 19 Oct 16
Posts: 80
Credit: 2,202,886
RAC: 0
Poland
Message 1039 - Posted: 9 Apr 2017, 20:50:13 UTC - in response to Message 1038.

Win10 X64
PC-IM v1.02 (sse2) 1600-1700 sec range with i7-5820k 4.2GHz
v1.2 SSE2 1750-1755 sec range

Linux X64 ubuntu 16.10LTS PC-IM v1.03 (fma) 2200-2250 sec average with xeon 2696 v3
v.1.2 (fma) 1940-1980 sec range

Same instruction to compare but different to system/os. So for these win took longer but linux shorter.

Thanks for these numbers. I did my tests on Windows using AVX version and it was faster for me. I suspect that new SSE version is slower. but I have to perform additional tests to confirm this. I will let you know when I will have some results.

I did extra benchmarks using 10 blocks from some VV WU instead of 1 like before. On my Windows machine new SSE app has results similar to AVX app. I also tried to benchmark 32-bit SSE app version and that one was slower than official SSE app. Maybe you downloaded 32-bit app instead of 64-bit one?
____________

Buro87 [Lombardia]
Send message
Joined: 23 Nov 16
Posts: 13
Credit: 657,363
RAC: 4,400
Italy
Message 1040 - Posted: 9 Apr 2017, 21:02:02 UTC - in response to Message 1039.

I have copleted WU with the new aptimization
i5-750
windows7 64bit SSE
before 2480-2550s CPU time
now 2260-2280s CPU time
a 9-12% gain
good job

Gunde
Send message
Joined: 7 Dec 16
Posts: 8
Credit: 20,880,133
RAC: 844
Sweden
Message 1041 - Posted: 9 Apr 2017, 21:18:50 UTC - in response to Message 1039.
Last modified: 9 Apr 2017, 22:04:11 UTC

Maybe got unlucky to task got this to win TN-Grid.windows-x86-64-sse2-v1.2.
And as you did running around 8 task then changed to AVX with similar result.

Process managers do not give info which bit version it use to this application so from zip file it should be correct.

I 27 min in to fma to i7 win 64, and will check status after that. So new result soon for this one.

Update: With fma i got around 200 sec in cpu time but run time a few sec longer. There still improvement to different system it tends to fluctuate.

Big thanks for the work. It will do big change in long run to all hosts.

koschi
Send message
Joined: 22 Oct 16
Posts: 24
Credit: 3,053,098
RAC: 39
Germany
Message 1045 - Posted: 10 Apr 2017, 19:34:55 UTC

Ryzen R7 @ 3.6GHz with Ubuntu

bin/pc_x86-64-avx-v1.2 input/tile2.txt output/output2.txt 0.05 1 2470 0 real 0m10.033s user 0m8.016s sys 0m0.028s bin/pc_x86-64-fma-v1.2 input/tile2.txt output/output2.txt 0.05 1 2470 0 real 0m9.828s user 0m7.824s sys 0m0.012s bin/pc_x86-64-sse2-v1.2 input/tile2.txt output/output2.txt 0.05 1 2470 0 real 0m11.075s user 0m9.068s sys 0m0.016s


Lets see what times that results in with FMA...

Krümel
Send message
Joined: 31 Oct 16
Posts: 15
Credit: 1,269,028
RAC: 524
Germany
Message 1046 - Posted: 10 Apr 2017, 20:37:32 UTC - in response to Message 1045.

Great job again Daniel.
R7 1700 @ 3,2 GHz (SMT on) = 1.950 Sec. (down from 2.350 Sec.) with Win 10.

Edit: AVX-App

Profile valterc
Project administrator
Project tester
Send message
Joined: 30 Oct 13
Posts: 320
Credit: 16,284,763
RAC: 4,149
Italy
Message 1052 - Posted: 13 Apr 2017, 9:40:07 UTC - in response to Message 1046.

Daniel made a great work again, the modifications he made are both efficient and elegant. Thanks a lot.

As usual, I will wait for some time before making the new optimized application 'official'. This will probably happen at the end of May (I'll be quite busy until then).

rattorosso [Marche]
Volunteer developer
Send message
Joined: 19 Dec 13
Posts: 25
Credit: 1,422,207
RAC: 3,625
Italy
Message 1054 - Posted: 16 Apr 2017, 23:10:52 UTC

This is a test run on my FX8320 with a real vv workunit kept from the project, the same for every app. Best time of 3 runs.

-> gene_pcim_v1.03_linux64__sse2 user 36m 4s -> gene_pcim_v1.03_linux64__avx user 35m 44s -> gene_pcim_v1.03_linux64__fma user 34m 47s -> TN-Grid.linux-x86-64-sse2-v1.2 user 32m 41s -> TN-Grid.linux-x86-64-avx-v1.2 user 32m 15s -> TN-Grid.linux-x86-64-fma-v1.2 user 31m 40s

Profile NxtGenCowboy
Send message
Joined: 26 Jan 17
Posts: 5
Credit: 432,072
RAC: 0
United States
Message 1056 - Posted: 26 Apr 2017, 6:07:51 UTC
Last modified: 26 Apr 2017, 6:08:20 UTC

Could someone recommend which version I should be using with Intel L7555 cpus? (4 of them)

Looks like 58 minutes using 1.03 sse2 (linux)

mmonnin
Send message
Joined: 24 Oct 16
Posts: 3
Credit: 378,496
RAC: 101
United States
Message 1057 - Posted: 28 Apr 2017, 20:44:23 UTC - in response to Message 1056.

Could someone recommend which version I should be using with Intel L7555 cpus? (4 of them)

Looks like 58 minutes using 1.03 sse2 (linux)


Looks like thats the best app version for you.
http://www.cpu-world.com/CPUs/Xeon/Intel-Xeon%20MP%20L7555%20-%20AT80604004875AA.html

Profile NxtGenCowboy
Send message
Joined: 26 Jan 17
Posts: 5
Credit: 432,072
RAC: 0
United States
Message 1058 - Posted: 1 May 2017, 18:00:06 UTC - in response to Message 1057.

Thanks!

Buro87 [Lombardia]
Send message
Joined: 23 Nov 16
Posts: 13
Credit: 657,363
RAC: 4,400
Italy
Message 1059 - Posted: 4 May 2017, 11:18:10 UTC - in response to Message 1058.

Hi daniel, i have a question for you

on my i5-6400 win7 64bit i recieve both avx an sse2 WU
if i want instal your optimization v1.2 which version i need to copy in the project folder?
- TN-Grid.windows-x86-64-avx-v1.2
- TN-Grid.windows-x86-64-sse2-v1.2
can i install both?

Profile Daniel
Volunteer developer
Send message
Joined: 19 Oct 16
Posts: 80
Credit: 2,202,886
RAC: 0
Poland
Message 1060 - Posted: 4 May 2017, 15:34:19 UTC - in response to Message 1059.
Last modified: 4 May 2017, 15:40:02 UTC

Hi daniel, i have a question for you

on my i5-6400 win7 64bit i recieve both avx an sse2 WU
if i want instal your optimization v1.2 which version i need to copy in the project folder?
- TN-Grid.windows-x86-64-avx-v1.2
- TN-Grid.windows-x86-64-sse2-v1.2
can i install both?

Your CPU also supports FMA instructions, so you can also try FMA app version: http://www.cpu-world.com/CPUs/Core_i5/Intel-Core%20i5-6400.html. In general FMA app version should be faster than AVX, which is faster than SSE one. However on some CPUs FMA versions for some reason is a bit slower than AVX one, so please try both.

It is possible to install few versions, but you would have to rename pc.exe files and modify app_info.xml to specify all app versions with proper plan classes. Files prepared by me are configured to run single app version only.
____________

Buro87 [Lombardia]
Send message
Joined: 23 Nov 16
Posts: 13
Credit: 657,363
RAC: 4,400
Italy
Message 1061 - Posted: 4 May 2017, 17:39:23 UTC - in response to Message 1060.

Hi daniel, i have a question for you

on my i5-6400 win7 64bit i recieve both avx an sse2 WU
if i want instal your optimization v1.2 which version i need to copy in the project folder?
- TN-Grid.windows-x86-64-avx-v1.2
- TN-Grid.windows-x86-64-sse2-v1.2
can i install both?

Your CPU also supports FMA instructions, so you can also try FMA app version: http://www.cpu-world.com/CPUs/Core_i5/Intel-Core%20i5-6400.html. In general FMA app version should be faster than AVX, which is faster than SSE one. However on some CPUs FMA versions for some reason is a bit slower than AVX one, so please try both.

It is possible to install few versions, but you would have to rename pc.exe files and modify app_info.xml to specify all app versions with proper plan classes. Files prepared by me are configured to run single app version only.


ok i will try fma app too. i use the i5-6400 since yesterday (60 wu completed) and i haven't recieve any fma WU
i will try all 3 apps from tomorrow

for now, both sse2 and avx standard app are between 1220 - 1290s cpu time

Buro87 [Lombardia]
Send message
Joined: 23 Nov 16
Posts: 13
Credit: 657,363
RAC: 4,400
Italy
Message 1063 - Posted: 12 May 2017, 22:40:08 UTC - in response to Message 1061.

hi Daniel i have a problem installing the app on the i5-6400 pc
in 10 days (around 500wu completed) i haave recived equal number of sse and avx WU. no fma wu
both sse and avx standard app are around 1250s so i will try sse first

i copy both pc.exe and app_info.xml in C:\Users\All Users\BOINC\projects\gene.disi.unitn.it_test\ but it doesn't work
i have todelete some existing file first?

koschi
Send message
Joined: 22 Oct 16
Posts: 24
Credit: 3,053,098
RAC: 39
Germany
Message 1064 - Posted: 15 May 2017, 8:18:50 UTC

Did you restart the BOINC Client after placing the files? Otherwise these won't be recognized...

Previous · 1 . . . 5 · 6 · 7 · 8 · 9 · 10 · Next
Post to thread

Message boards : Number crunching : Optimization


Main page · Your account · Message boards


Copyright © 2017 CNR-TN & UniTN