[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
Re: [REPORT] Nightly Performance Tests - Wednesday, August 19, 2020
|
From: |
Aleksandar Markovic |
|
Subject: |
Re: [REPORT] Nightly Performance Tests - Wednesday, August 19, 2020 |
|
Date: |
Sat, 22 Aug 2020 14:21:26 +0200 |
On Saturday, August 22, 2020, Aleksandar Markovic <aleksandar.qemu.devel@gmail.com> wrote:
On Wednesday, August 19, 2020, Ahmed Karaman <ahmedkhaledkaraman@gmail.com> wrote:
Host CPU : Intel(R) Core(TM) i7-8750H CPU @ 2.20GHz
Host Memory : 15.49 GB
Start Time (UTC) : 2020-08-19 21:00:01
End Time (UTC) : 2020-08-19 21:32:15
Execution Time : 0:32:14.021998
Status : SUCCESS
--------------------------------------------------------
I see we did not receive nightly report last night. The cause is most likely the change of our build system that happened yesterday.
I think the best approach for you is to start tonight "from scratch". So, with source code tree and all past data deleted - as if you execute the nighlies for the first time ever. This will cause a fresh checkout, and a recreation of 5.1 and 'latest' perfirmace data.
Sorry, I envision some problems with the approach I described. I think you should better create a separate source directory for reference 5.1 measurements, and another source directory for all measurements from tonight on. That way you will avoid switching between build systems from within the same directory.
Thanks,
Aleksandar
Unrelated hint:
Please include the following (or similar) text right before the tables with results:
"'-----' denotes difference less than 0.01%."
This way the readers will not be confused with '-----' meaning.
Yours,
Aleksandar
SUMMARY REPORT - COMMIT 672b2f26
--------------------------------------------------------
AVERAGE RESULTS
--------------------------------------------------------
Target Instructions Latest v5.1.0
---------- -------------------- ---------- ----------
aarch64 2 118 484 879 ----- -----
alpha 1 838 407 216 ----- -----
arm 7 887 992 884 ----- -----
hppa 4 124 996 474 ----- -----
m68k 2 453 421 671 ----- -----
mips 1 812 636 995 ----- -----
mipsel 1 947 725 352 ----- -----
mips64 1 862 495 613 ----- -----
mips64el 1 984 211 702 ----- -----
ppc 2 394 319 834 ----- -----
ppc64 2 488 040 622 ----- -----
ppc64le 2 470 198 016 ----- -----
riscv64 1 367 774 718 ----- -----
s390x 3 058 498 362 ----- -----
sh4 2 278 490 061 ----- -----
sparc64 3 186 999 246 ----- -----
x86_64 1 734 475 394 ----- -----
--------------------------------------------------------
DETAILED RESULTS
--------------------------------------------------------
Test Program: dijkstra_double
--------------------------------------------------------
Target Instructions Latest v5.1.0
---------- -------------------- ---------- ----------
aarch64 3 019 613 303 ----- -----
alpha 3 078 110 233 ----- -----
arm 15 982 079 823 ----- -----
hppa 7 012 014 505 ----- -----
m68k 3 914 631 319 ----- -----
mips 2 979 137 836 ----- -----
mipsel 3 141 391 810 ----- -----
mips64 3 163 713 203 ----- -----
mips64el 3 314 105 619 ----- -----
ppc 4 692 148 212 ----- -----
ppc64 4 875 585 404 ----- -----
ppc64le 4 859 857 200 ----- -----
riscv64 2 150 267 230 ----- -----
s390x 4 455 507 359 ----- -----
sh4 3 816 841 775 ----- -----
sparc64 4 399 783 149 ----- -----
x86_64 2 441 371 746 ----- -----
--------------------------------------------------------
--------------------------------------------------------
Test Program: dijkstra_int32
--------------------------------------------------------
Target Instructions Latest v5.1.0
---------- -------------------- ---------- ----------
aarch64 2 177 687 656 ----- -----
alpha 1 462 693 182 ----- -----
arm 8 048 440 634 ----- -----
hppa 5 053 362 217 ----- -----
m68k 1 683 346 196 ----- -----
mips 1 473 265 047 ----- -----
mipsel 1 475 326 892 ----- -----
mips64 1 683 560 350 ----- -----
mips64el 1 663 467 060 ----- -----
ppc 1 978 581 291 ----- -----
ppc64 2 160 088 877 ----- -----
ppc64le 2 151 841 575 ----- -----
riscv64 1 323 226 597 ----- -----
s390x 2 880 509 792 ----- -----
sh4 1 938 787 291 ----- -----
sparc64 2 768 217 627 ----- -----
x86_64 1 521 726 675 ----- -----
--------------------------------------------------------
--------------------------------------------------------
Test Program: matmult_double
--------------------------------------------------------
Target Instructions Latest v5.1.0
---------- -------------------- ---------- ----------
aarch64 1 408 042 295 ----- -----
alpha 3 009 129 018 ----- -----
arm 8 453 187 175 ----- -----
hppa 3 334 593 464 ----- -----
m68k 3 309 165 600 ----- -----
mips 2 252 644 394 ----- -----
mipsel 3 166 010 232 ----- -----
mips64 2 266 660 274 ----- -----
mips64el 3 179 408 969 ----- -----
ppc 3 108 563 525 ----- -----
ppc64 3 186 404 684 ----- -----
ppc64le 3 186 105 591 ----- -----
riscv64 1 218 230 013 ----- -----
s390x 2 715 954 030 ----- -----
sh4 3 330 300 193 ----- -----
sparc64 3 197 860 268 ----- -----
x86_64 1 244 922 914 ----- -----
--------------------------------------------------------
--------------------------------------------------------
Test Program: matmult_int32
--------------------------------------------------------
Target Instructions Latest v5.1.0
---------- -------------------- ---------- ----------
aarch64 595 215 814 ----- -----
alpha 369 955 794 ----- -----
arm 735 842 738 ----- -----
hppa 666 414 556 ----- -----
m68k 406 857 412 ----- -----
mips 497 082 899 ----- -----
mipsel 497 032 468 ----- -----
mips64 478 686 174 ----- -----
mips64el 462 210 845 ----- -----
ppc 338 165 176 ----- -----
ppc64 390 046 801 ----- -----
ppc64le 390 236 162 ----- -----
riscv64 348 989 619 ----- -----
s390x 491 496 329 ----- -----
sh4 399 095 487 ----- -----
sparc64 490 124 541 ----- -----
x86_64 399 613 899 ----- -----
--------------------------------------------------------
--------------------------------------------------------
Test Program: qsort_double
--------------------------------------------------------
Target Instructions Latest v5.1.0
---------- -------------------- ---------- ----------
aarch64 2 645 742 637 ----- -----
alpha 1 899 562 379 ----- -----
arm 8 113 107 429 ----- -----
hppa 3 098 469 739 ----- -----
m68k 4 302 051 049 ----- -----
mips 2 060 965 462 ----- -----
mipsel 2 061 404 232 ----- -----
mips64 1 933 231 416 ----- -----
mips64el 1 930 636 000 ----- -----
ppc 2 673 960 745 ----- -----
ppc64 2 623 577 315 ----- -----
ppc64le 2 580 240 728 ----- -----
riscv64 1 575 021 518 ----- -----
s390x 2 437 147 903 ----- -----
sh4 2 520 101 855 ----- -----
sparc64 3 882 349 298 ----- -----
x86_64 1 969 776 338 ----- -----
--------------------------------------------------------
--------------------------------------------------------
Test Program: qsort_int32
--------------------------------------------------------
Target Instructions Latest v5.1.0
---------- -------------------- ---------- ----------
aarch64 2 131 273 662 ----- -----
alpha 1 460 090 651 ----- -----
arm 3 372 526 755 ----- -----
hppa 2 196 131 815 ----- -----
m68k 1 779 454 745 ----- -----
mips 1 500 097 569 ----- -----
mipsel 1 502 804 063 ----- -----
mips64 1 497 347 136 ----- -----
mips64el 1 476 627 156 ----- -----
ppc 1 667 589 417 ----- -----
ppc64 1 779 203 387 ----- -----
ppc64le 1 728 565 582 ----- -----
riscv64 1 288 897 227 ----- -----
s390x 2 113 929 796 ----- -----
sh4 1 878 433 512 ----- -----
sparc64 3 353 723 284 ----- -----
x86_64 1 751 619 062 ----- -----
--------------------------------------------------------
--------------------------------------------------------
Test Program: qsort_string
--------------------------------------------------------
Target Instructions Latest v5.1.0
---------- -------------------- ---------- ----------
aarch64 2 529 811 267 ----- -----
alpha 1 793 314 577 ----- -----
arm 7 155 792 109 ----- -----
hppa 4 595 956 496 ----- -----
m68k 2 294 974 463 ----- -----
mips 2 113 124 208 ----- -----
mipsel 2 110 049 468 ----- -----
mips64 1 967 925 447 ----- -----
mips64el 1 950 320 901 ----- -----
ppc 2 428 056 923 ----- -----
ppc64 2 404 890 978 ----- -----
ppc64le 2 385 487 957 ----- -----
riscv64 1 563 271 793 ----- -----
s390x 3 934 075 315 ----- -----
sh4 2 097 732 542 ----- -----
sparc64 4 131 589 952 ----- -----
x86_64 2 864 598 485 ----- -----
--------------------------------------------------------
--------------------------------------------------------
Test Program: search_string
--------------------------------------------------------
Target Instructions Latest v5.1.0
---------- -------------------- ---------- ----------
aarch64 2 440 492 400 ----- -----
alpha 1 634 401 901 ----- -----
arm 11 242 966 409 ----- -----
hppa 7 043 029 003 ----- -----
m68k 1 936 892 588 ----- -----
mips 1 624 778 552 ----- -----
mipsel 1 627 783 657 ----- -----
mips64 1 908 840 910 ----- -----
mips64el 1 896 917 069 ----- -----
ppc 2 267 493 386 ----- -----
ppc64 2 484 527 533 ----- -----
ppc64le 2 479 249 335 ----- -----
riscv64 1 474 293 752 ----- -----
s390x 5 439 366 376 ----- -----
sh4 2 246 627 833 ----- -----
sparc64 3 272 345 849 ----- -----
x86_64 1 682 174 033 ----- -----
--------------------------------------------------------