This commit is contained in:
Benchmark
2024-11-23 01:29:36 +00:00
parent 48928b133c
commit 97e33d5a7f
4 changed files with 107 additions and 0 deletions

View File

@@ -0,0 +1,2 @@
URI ID Name Environment Runner Instance type Architecture CPU CPU cores RAM Kernel OS GCC Dedicated instance Deeper C-states Turbo boost Hyper-threading Time
2024/2024_11_23_00_50_28_1_aws_x86_64_c7i_metal_24xl aws_x86_64_c7i_metal_24xl AWS x86_64 (c7i.24xl) aws host c7i.metal-24xl x86_64 48 188 GB 6.1.115-126.197.amzn2023.x86_64 Amazon Linux 2023.6.20241121 11.4.1 1 0 0 0 2024-11-23 00:50:28
1 URI ID Name Environment Runner Instance type Architecture CPU CPU cores RAM Kernel OS GCC Dedicated instance Deeper C-states Turbo boost Hyper-threading Time
2 2024/2024_11_23_00_50_28_1_aws_x86_64_c7i_metal_24xl aws_x86_64_c7i_metal_24xl AWS x86_64 (c7i.24xl) aws host c7i.metal-24xl x86_64 48 188 GB 6.1.115-126.197.amzn2023.x86_64 Amazon Linux 2023.6.20241121 11.4.1 1 0 0 0 2024-11-23 00:50:28

View File

@@ -0,0 +1,60 @@
### AWS x86_64 (c7i.24xl)
| Attribute | Value |
|---------------|----------------|
| Environment |aws|
| Runner |host|
| Instance type |c7i.metal-24xl (dedicated)|
| Architecture |x86_64
| CPU |48 cores|
| CPU settings |disabled deeper C-states, disabled turbo boost, disabled hyper-threading|
| RAM |188 GB|
| Kernel |6.1.115-126.197.amzn2023.x86_64|
| OS |Amazon Linux 2023.6.20241121|
| GCC |11.4.1|
| Time |2024-11-23 00:50:28 UTC|
### Laravel 11.1.2 demo app - 50 consecutive runs, 100 requests (sec)
| PHP | Min | Max | Std dev | Average | Average diff % | Median | Median diff % | Memory |
|-------------|-------------|-------------|--------------|------------|-----------------|------------|---------------|---------------|
|[PHP - baseline@d5f6](https://github.com/php/php-src/commit/d5f6e56610)|0.43873|0.44122|0.00050|0.43950|0.00%|0.43941|0.00%|41.83 MB|
|[PHP - previous master](https://github.com/php/php-src/commit/ccda20b8d1)|0.43639|0.43844|0.00044|0.43738|-0.48%|0.43732|-0.48%|41.71 MB|
|[PHP - master](https://github.com/php/php-src/commit/c84b7ed0c5)|0.43644|0.43817|0.00039|0.43718|-0.53%|0.43714|-0.52%|41.71 MB|
|[PHP - master (JIT)](https://github.com/php/php-src/commit/c84b7ed0c5)|0.42357|0.42501|0.00035|0.42426|-3.47%|0.42427|-3.45%|50.76 MB|
### Symfony 2.6.0 demo app - 50 consecutive runs, 100 requests (sec)
| PHP | Min | Max | Std dev | Average | Average diff % | Median | Median diff % | Memory |
|-------------|-------------|-------------|--------------|------------|-----------------|------------|---------------|---------------|
|[PHP - baseline@d5f6](https://github.com/php/php-src/commit/d5f6e56610)|0.71188|0.71593|0.00081|0.71346|0.00%|0.71347|0.00%|37.35 MB|
|[PHP - previous master](https://github.com/php/php-src/commit/ccda20b8d1)|0.70538|0.71010|0.00106|0.70708|-0.89%|0.70678|-0.94%|37.41 MB|
|[PHP - master](https://github.com/php/php-src/commit/c84b7ed0c5)|0.70581|0.71031|0.00098|0.70742|-0.85%|0.70718|-0.88%|37.41 MB|
|[PHP - master (JIT)](https://github.com/php/php-src/commit/c84b7ed0c5)|0.68016|0.68365|0.00070|0.68140|-4.49%|0.68127|-4.51%|44.46 MB|
### Wordpress 6.2 main page - 50 consecutive runs, 20 requests (sec)
| PHP | Min | Max | Std dev | Average | Average diff % | Median | Median diff % | Memory |
|-------------|-------------|-------------|--------------|------------|-----------------|------------|---------------|---------------|
|[PHP - baseline@d5f6](https://github.com/php/php-src/commit/d5f6e56610)|0.58044|0.58342|0.00062|0.58191|0.00%|0.58194|0.00%|42.97 MB|
|[PHP - previous master](https://github.com/php/php-src/commit/ccda20b8d1)|0.57595|0.58005|0.00096|0.57797|-0.68%|0.57801|-0.67%|42.80 MB|
|[PHP - master](https://github.com/php/php-src/commit/c84b7ed0c5)|0.57640|0.57887|0.00052|0.57745|-0.77%|0.57736|-0.79%|42.81 MB|
|[PHP - master (JIT)](https://github.com/php/php-src/commit/c84b7ed0c5)|0.51716|0.52376|0.00161|0.52134|-10.41%|0.52181|-10.33%|60.61 MB|
### bench.php - 50 consecutive runs (sec)
| PHP | Min | Max | Std dev | Average | Average diff % | Median | Median diff % | Memory |
|-------------|-------------|-------------|--------------|------------|-----------------|------------|---------------|---------------|
|[PHP - baseline@d5f6](https://github.com/php/php-src/commit/d5f6e56610)|0.21463|0.21920|0.00098|0.21636|0.00%|0.21628|0.00%|26.14 MB|
|[PHP - previous master](https://github.com/php/php-src/commit/ccda20b8d1)|0.21452|0.21858|0.00086|0.21610|-0.12%|0.21611|-0.08%|26.14 MB|
|[PHP - master](https://github.com/php/php-src/commit/c84b7ed0c5)|0.21486|0.21861|0.00077|0.21628|-0.04%|0.21610|-0.09%|26.14 MB|
|[PHP - master (JIT)](https://github.com/php/php-src/commit/c84b7ed0c5)|0.07269|0.07738|0.00094|0.07522|-65.24%|0.07517|-65.25%|27.30 MB|
### micro_bench.php - 50 consecutive runs (sec)
| PHP | Min | Max | Std dev | Average | Average diff % | Median | Median diff % | Memory |
|-------------|-------------|-------------|--------------|------------|-----------------|------------|---------------|---------------|
|[PHP - baseline@d5f6](https://github.com/php/php-src/commit/d5f6e56610)|1.34016|1.36967|0.00639|1.35173|0.00%|1.35155|0.00%|20.39 MB|
|[PHP - previous master](https://github.com/php/php-src/commit/ccda20b8d1)|1.27198|1.30448|0.00777|1.28864|-4.67%|1.28893|-4.63%|20.39 MB|
|[PHP - master](https://github.com/php/php-src/commit/c84b7ed0c5)|1.27461|1.30405|0.00730|1.28939|-4.61%|1.28891|-4.63%|20.40 MB|
|[PHP - master (JIT)](https://github.com/php/php-src/commit/c84b7ed0c5)|0.51751|0.54307|0.00494|0.53054|-60.75%|0.53102|-60.71%|21.71 MB|

View File

@@ -0,0 +1,21 @@
Test name Test warmup Test iterations Test requests PHP PHP Commit hash PHP Commit URL Min Max Std dev Average Average diff % Median Median diff % Instruction count Memory usage
Laravel 11.1.2 demo app 50 50 100 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 0.43873 0.44122 0.00050 0.43950 0.00 0.43941 0.00 0 41.83
Laravel 11.1.2 demo app 50 50 100 PHP - previous master ccda20b8d1 https://github.com/php/php-src/commit/ccda20b8d1 0.43639 0.43844 0.00044 0.43738 -0.48 0.43732 -0.48 0 41.71
Laravel 11.1.2 demo app 50 50 100 PHP - master c84b7ed0c5 https://github.com/php/php-src/commit/c84b7ed0c5 0.43644 0.43817 0.00039 0.43718 -0.53 0.43714 -0.52 0 41.71
Laravel 11.1.2 demo app 50 50 100 PHP - master (JIT) c84b7ed0c5 https://github.com/php/php-src/commit/c84b7ed0c5 0.42357 0.42501 0.00035 0.42426 -3.47 0.42427 -3.45 0 50.76
Symfony 2.6.0 demo app 50 50 100 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 0.71188 0.71593 0.00081 0.71346 0.00 0.71347 0.00 0 37.35
Symfony 2.6.0 demo app 50 50 100 PHP - previous master ccda20b8d1 https://github.com/php/php-src/commit/ccda20b8d1 0.70538 0.71010 0.00106 0.70708 -0.89 0.70678 -0.94 0 37.41
Symfony 2.6.0 demo app 50 50 100 PHP - master c84b7ed0c5 https://github.com/php/php-src/commit/c84b7ed0c5 0.70581 0.71031 0.00098 0.70742 -0.85 0.70718 -0.88 0 37.41
Symfony 2.6.0 demo app 50 50 100 PHP - master (JIT) c84b7ed0c5 https://github.com/php/php-src/commit/c84b7ed0c5 0.68016 0.68365 0.00070 0.68140 -4.49 0.68127 -4.51 0 44.46
Wordpress 6.2 main page 10 50 20 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 0.58044 0.58342 0.00062 0.58191 0.00 0.58194 0.00 0 42.97
Wordpress 6.2 main page 10 50 20 PHP - previous master ccda20b8d1 https://github.com/php/php-src/commit/ccda20b8d1 0.57595 0.58005 0.00096 0.57797 -0.68 0.57801 -0.67 0 42.80
Wordpress 6.2 main page 10 50 20 PHP - master c84b7ed0c5 https://github.com/php/php-src/commit/c84b7ed0c5 0.57640 0.57887 0.00052 0.57745 -0.77 0.57736 -0.79 0 42.81
Wordpress 6.2 main page 10 50 20 PHP - master (JIT) c84b7ed0c5 https://github.com/php/php-src/commit/c84b7ed0c5 0.51716 0.52376 0.00161 0.52134 -10.41 0.52181 -10.33 0 60.61
bench.php 10 50 0 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 0.21463 0.21920 0.00098 0.21636 0.00 0.21628 0.00 0 26.14
bench.php 10 50 0 PHP - previous master ccda20b8d1 https://github.com/php/php-src/commit/ccda20b8d1 0.21452 0.21858 0.00086 0.21610 -0.12 0.21611 -0.08 0 26.14
bench.php 10 50 0 PHP - master c84b7ed0c5 https://github.com/php/php-src/commit/c84b7ed0c5 0.21486 0.21861 0.00077 0.21628 -0.04 0.21610 -0.09 0 26.14
bench.php 10 50 0 PHP - master (JIT) c84b7ed0c5 https://github.com/php/php-src/commit/c84b7ed0c5 0.07269 0.07738 0.00094 0.07522 -65.24 0.07517 -65.25 0 27.30
micro_bench.php 10 50 0 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 1.34016 1.36967 0.00639 1.35173 0.00 1.35155 0.00 0 20.39
micro_bench.php 10 50 0 PHP - previous master ccda20b8d1 https://github.com/php/php-src/commit/ccda20b8d1 1.27198 1.30448 0.00777 1.28864 -4.67 1.28893 -4.63 0 20.39
micro_bench.php 10 50 0 PHP - master c84b7ed0c5 https://github.com/php/php-src/commit/c84b7ed0c5 1.27461 1.30405 0.00730 1.28939 -4.61 1.28891 -4.63 0 20.40
micro_bench.php 10 50 0 PHP - master (JIT) c84b7ed0c5 https://github.com/php/php-src/commit/c84b7ed0c5 0.51751 0.54307 0.00494 0.53054 -60.75 0.53102 -60.71 0 21.71
1 Test name Test warmup Test iterations Test requests PHP PHP Commit hash PHP Commit URL Min Max Std dev Average Average diff % Median Median diff % Instruction count Memory usage
2 Laravel 11.1.2 demo app 50 50 100 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 0.43873 0.44122 0.00050 0.43950 0.00 0.43941 0.00 0 41.83
3 Laravel 11.1.2 demo app 50 50 100 PHP - previous master ccda20b8d1 https://github.com/php/php-src/commit/ccda20b8d1 0.43639 0.43844 0.00044 0.43738 -0.48 0.43732 -0.48 0 41.71
4 Laravel 11.1.2 demo app 50 50 100 PHP - master c84b7ed0c5 https://github.com/php/php-src/commit/c84b7ed0c5 0.43644 0.43817 0.00039 0.43718 -0.53 0.43714 -0.52 0 41.71
5 Laravel 11.1.2 demo app 50 50 100 PHP - master (JIT) c84b7ed0c5 https://github.com/php/php-src/commit/c84b7ed0c5 0.42357 0.42501 0.00035 0.42426 -3.47 0.42427 -3.45 0 50.76
6 Symfony 2.6.0 demo app 50 50 100 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 0.71188 0.71593 0.00081 0.71346 0.00 0.71347 0.00 0 37.35
7 Symfony 2.6.0 demo app 50 50 100 PHP - previous master ccda20b8d1 https://github.com/php/php-src/commit/ccda20b8d1 0.70538 0.71010 0.00106 0.70708 -0.89 0.70678 -0.94 0 37.41
8 Symfony 2.6.0 demo app 50 50 100 PHP - master c84b7ed0c5 https://github.com/php/php-src/commit/c84b7ed0c5 0.70581 0.71031 0.00098 0.70742 -0.85 0.70718 -0.88 0 37.41
9 Symfony 2.6.0 demo app 50 50 100 PHP - master (JIT) c84b7ed0c5 https://github.com/php/php-src/commit/c84b7ed0c5 0.68016 0.68365 0.00070 0.68140 -4.49 0.68127 -4.51 0 44.46
10 Wordpress 6.2 main page 10 50 20 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 0.58044 0.58342 0.00062 0.58191 0.00 0.58194 0.00 0 42.97
11 Wordpress 6.2 main page 10 50 20 PHP - previous master ccda20b8d1 https://github.com/php/php-src/commit/ccda20b8d1 0.57595 0.58005 0.00096 0.57797 -0.68 0.57801 -0.67 0 42.80
12 Wordpress 6.2 main page 10 50 20 PHP - master c84b7ed0c5 https://github.com/php/php-src/commit/c84b7ed0c5 0.57640 0.57887 0.00052 0.57745 -0.77 0.57736 -0.79 0 42.81
13 Wordpress 6.2 main page 10 50 20 PHP - master (JIT) c84b7ed0c5 https://github.com/php/php-src/commit/c84b7ed0c5 0.51716 0.52376 0.00161 0.52134 -10.41 0.52181 -10.33 0 60.61
14 bench.php 10 50 0 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 0.21463 0.21920 0.00098 0.21636 0.00 0.21628 0.00 0 26.14
15 bench.php 10 50 0 PHP - previous master ccda20b8d1 https://github.com/php/php-src/commit/ccda20b8d1 0.21452 0.21858 0.00086 0.21610 -0.12 0.21611 -0.08 0 26.14
16 bench.php 10 50 0 PHP - master c84b7ed0c5 https://github.com/php/php-src/commit/c84b7ed0c5 0.21486 0.21861 0.00077 0.21628 -0.04 0.21610 -0.09 0 26.14
17 bench.php 10 50 0 PHP - master (JIT) c84b7ed0c5 https://github.com/php/php-src/commit/c84b7ed0c5 0.07269 0.07738 0.00094 0.07522 -65.24 0.07517 -65.25 0 27.30
18 micro_bench.php 10 50 0 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 1.34016 1.36967 0.00639 1.35173 0.00 1.35155 0.00 0 20.39
19 micro_bench.php 10 50 0 PHP - previous master ccda20b8d1 https://github.com/php/php-src/commit/ccda20b8d1 1.27198 1.30448 0.00777 1.28864 -4.67 1.28893 -4.63 0 20.39
20 micro_bench.php 10 50 0 PHP - master c84b7ed0c5 https://github.com/php/php-src/commit/c84b7ed0c5 1.27461 1.30405 0.00730 1.28939 -4.61 1.28891 -4.63 0 20.40
21 micro_bench.php 10 50 0 PHP - master (JIT) c84b7ed0c5 https://github.com/php/php-src/commit/c84b7ed0c5 0.51751 0.54307 0.00494 0.53054 -60.75 0.53102 -60.71 0 21.71

View File

@@ -1318,3 +1318,27 @@ micro_bench.php 10 50 0 PHP - previous master 91f0b3bc04 https://github.com/php/
micro_bench.php 10 50 0 PHP - master ccda20b8d1 https://github.com/php/php-src/commit/ccda20b8d1 1.27671 1.31078 0.00752 1.29037 -4.58 1.28996 -4.54 0 20.38
micro_bench.php 10 50 0 PHP - master (JIT) ccda20b8d1 https://github.com/php/php-src/commit/ccda20b8d1 0.53338 0.55407 0.00542 0.54297 -59.85 0.54365 -59.77 0 21.69
URI ID Name Environment Runner Instance type Architecture CPU CPU cores RAM Kernel OS GCC Dedicated instance Deeper C-states Turbo boost Hyper-threading Time
2024/2024_11_23_00_50_28_1_aws_x86_64_c7i_metal_24xl aws_x86_64_c7i_metal_24xl AWS x86_64 (c7i.24xl) aws host c7i.metal-24xl x86_64 48 188 GB 6.1.115-126.197.amzn2023.x86_64 Amazon Linux 2023.6.20241121 11.4.1 1 0 0 0 2024-11-23 00:50:28
Test name Test warmup Test iterations Test requests PHP PHP Commit hash PHP Commit URL Min Max Std dev Average Average diff % Median Median diff % Instruction count Memory usage
Laravel 11.1.2 demo app 50 50 100 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 0.43873 0.44122 0.00050 0.43950 0.00 0.43941 0.00 0 41.83
Laravel 11.1.2 demo app 50 50 100 PHP - previous master ccda20b8d1 https://github.com/php/php-src/commit/ccda20b8d1 0.43639 0.43844 0.00044 0.43738 -0.48 0.43732 -0.48 0 41.71
Laravel 11.1.2 demo app 50 50 100 PHP - master c84b7ed0c5 https://github.com/php/php-src/commit/c84b7ed0c5 0.43644 0.43817 0.00039 0.43718 -0.53 0.43714 -0.52 0 41.71
Laravel 11.1.2 demo app 50 50 100 PHP - master (JIT) c84b7ed0c5 https://github.com/php/php-src/commit/c84b7ed0c5 0.42357 0.42501 0.00035 0.42426 -3.47 0.42427 -3.45 0 50.76
Symfony 2.6.0 demo app 50 50 100 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 0.71188 0.71593 0.00081 0.71346 0.00 0.71347 0.00 0 37.35
Symfony 2.6.0 demo app 50 50 100 PHP - previous master ccda20b8d1 https://github.com/php/php-src/commit/ccda20b8d1 0.70538 0.71010 0.00106 0.70708 -0.89 0.70678 -0.94 0 37.41
Symfony 2.6.0 demo app 50 50 100 PHP - master c84b7ed0c5 https://github.com/php/php-src/commit/c84b7ed0c5 0.70581 0.71031 0.00098 0.70742 -0.85 0.70718 -0.88 0 37.41
Symfony 2.6.0 demo app 50 50 100 PHP - master (JIT) c84b7ed0c5 https://github.com/php/php-src/commit/c84b7ed0c5 0.68016 0.68365 0.00070 0.68140 -4.49 0.68127 -4.51 0 44.46
Wordpress 6.2 main page 10 50 20 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 0.58044 0.58342 0.00062 0.58191 0.00 0.58194 0.00 0 42.97
Wordpress 6.2 main page 10 50 20 PHP - previous master ccda20b8d1 https://github.com/php/php-src/commit/ccda20b8d1 0.57595 0.58005 0.00096 0.57797 -0.68 0.57801 -0.67 0 42.80
Wordpress 6.2 main page 10 50 20 PHP - master c84b7ed0c5 https://github.com/php/php-src/commit/c84b7ed0c5 0.57640 0.57887 0.00052 0.57745 -0.77 0.57736 -0.79 0 42.81
Wordpress 6.2 main page 10 50 20 PHP - master (JIT) c84b7ed0c5 https://github.com/php/php-src/commit/c84b7ed0c5 0.51716 0.52376 0.00161 0.52134 -10.41 0.52181 -10.33 0 60.61
bench.php 10 50 0 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 0.21463 0.21920 0.00098 0.21636 0.00 0.21628 0.00 0 26.14
bench.php 10 50 0 PHP - previous master ccda20b8d1 https://github.com/php/php-src/commit/ccda20b8d1 0.21452 0.21858 0.00086 0.21610 -0.12 0.21611 -0.08 0 26.14
bench.php 10 50 0 PHP - master c84b7ed0c5 https://github.com/php/php-src/commit/c84b7ed0c5 0.21486 0.21861 0.00077 0.21628 -0.04 0.21610 -0.09 0 26.14
bench.php 10 50 0 PHP - master (JIT) c84b7ed0c5 https://github.com/php/php-src/commit/c84b7ed0c5 0.07269 0.07738 0.00094 0.07522 -65.24 0.07517 -65.25 0 27.30
micro_bench.php 10 50 0 PHP - baseline@d5f6 d5f6e56610 https://github.com/php/php-src/commit/d5f6e56610 1.34016 1.36967 0.00639 1.35173 0.00 1.35155 0.00 0 20.39
micro_bench.php 10 50 0 PHP - previous master ccda20b8d1 https://github.com/php/php-src/commit/ccda20b8d1 1.27198 1.30448 0.00777 1.28864 -4.67 1.28893 -4.63 0 20.39
micro_bench.php 10 50 0 PHP - master c84b7ed0c5 https://github.com/php/php-src/commit/c84b7ed0c5 1.27461 1.30405 0.00730 1.28939 -4.61 1.28891 -4.63 0 20.40
micro_bench.php 10 50 0 PHP - master (JIT) c84b7ed0c5 https://github.com/php/php-src/commit/c84b7ed0c5 0.51751 0.54307 0.00494 0.53054 -60.75 0.53102 -60.71 0 21.71
1 URI ID Name Environment Runner Instance type Architecture CPU CPU cores RAM Kernel OS GCC Dedicated instance Deeper C-states Turbo boost Hyper-threading Time
1318
1319
1320
1321
1322
1323
1324
1325
1326
1327
1328
1329
1330
1331
1332
1333
1334
1335
1336
1337
1338
1339
1340
1341
1342
1343
1344